Design, build, and maintain scalable data pipelines on Microsoft Fabric. Partner with Data Scientists and ML Engineers to operationalize models. Implement data quality frameworks and ensure compliance with governance and security standards.
Key Highlights
Technical Skills Required
Benefits & Perks
Job Description
For one of my customer in Europe we are looking for a Senior AI Data Engineer with experience in Microsoft Fabric.
Location: Europe(100% remote)
Duration: 12+ months(renewable)
Description:
We are looking for an experienced AI Data Engineer with deep hands-on knowledge of Microsoft Fabric, Azure Data services, and modern data engineering practices. The ideal candidate will build, optimize, and maintain scalable data pipelines supporting advanced analytics and AI/ML initiatives across the organization.
Key Responsibilities
Data Engineering & Architecture
- Design, build, and maintain scalable data pipelines on Microsoft Fabric (Data Factory, Dataflows, Lakehouse, Warehouse, OneLake).
- Develop robust data ingestion, transformation, and orchestration processes using Azure Data Factory, Azure Databricks, Azure Synapse, and Azure Functions.
- Implement and optimize Delta Lake architectures for structured and unstructured data.
- Build reusable data products to support AI, machine learning, and analytics workloads.
AI & Advanced Analytics Integration
- Partner with Data Scientists and ML Engineers to operationalize models using Azure Machine Learning, Fabric Data Science experiences, or Databricks.
- Prepare and feature-engineer datasets tailored for AI workloads.
- Automate MLOps workflows, model monitoring, and deployment pipelines.
Governance, Quality & Security
- Implement data quality frameworks, observability, monitoring, and lineage using Fabric and Azure Purview.
- Ensure compliance with governance, data privacy, and security standards.
- Manage CI/CD pipelines for data code using Azure DevOps or GitHub.
Collaboration & Stakeholder Engagement
- Collaborate with business analysts, product owners, and domain experts to understand requirements and deliver high-value data solutions.
- Maintain documentation of data sources, data models, pipelines, and best practices.
- Provide technical guidance and mentorship to junior developers.
Required Skills & Qualifications
- 10+ years of experience as a Data Engineer, AI Engineer, or similar role.
- Strong hands-on experience with Microsoft Fabric (Lakehouse, Data Engineering, Data Factory, Data Pipelines).
- Expert knowledge of Azure Data Services:
- Azure Data Factory
- Azure Databricks / Spark
- Azure Synapse / SQL Pools
- Azure Storage (ADLS Gen2)
- Azure Functions
- Azure Machine Learning
- Proficiency in Python and SQL for data processing and transformation.
- Experience building data lakehouse architectures and Delta Lake pipelines.
- Knowledge of modern DevOps/MLOps practices, including version control, testing, and automated deployment.
- Familiarity with data governance frameworks using Azure Purview or Fabric governance.