Skip to content
← All competencies & projects
ProjectMakers / Internal projectPeriod not documented

Microsoft Fabric data pipeline and offline deployment of container applications

MY ROLEProject lead, data/software architect and developer

As project lead, data/software architect and developer, I implemented a Python data pipeline for operational events and time-series data, together with a procedure for offline deployment of a container application.

Source data was ingested through APIs, validated and transferred to a Microsoft Fabric lakehouse with Delta tables. Tests for data quality, repeatable processing and error handling accompanied implementation. Deployment and monitoring were automated.

A deployment procedure was developed for a container application in an isolated environment. Images and dependencies were prepared with versioning and delivered through a local registry. Installation, updates and rollback were tested without external network access and documented in the operations manual.

Result: Built a data pipeline with a Fabric lakehouse and quality checks, and implemented documented offline deployment for container applications.

Technologies & competencies

PythonMicrosoft FabricLakehouseDelta TablesData modellingTime-series data processingData qualityLinuxContainerLocal container registryAir-GapSBOMRollbackCI/CDProject leadership