Data Engineer With MS Fabric

About this job

Job Summary

We are looking for an experienced Azure Data Engineer with strong Microsoft Fabric expertise to design, develop, and optimize modern data and analytics solutions. The role requires hands-on experience across Fabric Lakehouse,Warehouse,OneLake,Data Factory, PySpark, Power BI, DAX, semantic models, and Data Agents. The ideal candidate should be strong in both data engineering and analytics, with a particular focus on performance optimization, scalable data modeling, and AI-enabled data solutions.

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines using Microsoft Fabric Data Factory, Dataflows Gen2, SQL, Python, and PySpark.
• Build and optimize Lakehouse, Warehouse, OneLake, and Delta Lake solutions using Bronze/Silver/Gold architecture.
• Develop complex T-SQL queries, views, transformations, and dimensional data models using star schema, fact/dimension tables, and SCD.
• Develop and optimize Power BI semantic models, DAX measures, Power Query, and reports.
• Implement and optimize Direct Lake models while minimizing unnecessary DirectQuery fallback.
• Design and maintain Fabric Data Agents and validate AI-generated SQL, Pyspark, and DAX using Copilot/Fabric AI capabilities.
• Perform end-to-end performance tuning across Spark/PySpark, SQL Warehouse, Delta tables, Data Factory, Power BI, DAX, and Fabric capacity.
• Optimize Delta tables using appropriate partitioning, OPTIMIZE, VACUUM, and V-Order strategies.
• Monitor workloads using Spark UI, Query Insights, Monitoring Hub, and Capacity Metrics.
• Implement CI/CD using Git/Azure DevOps/GitHub and Fabric deployment pipelines.
• Apply security and governance using Microsoft Entra ID, workspace roles, OneLake security, and Microsoft Purview.
• Collaborate with analysts, BI developers, data scientists, and business stakeholders to deliver production-ready data solutions.

Required Skills

• 2-6 years of experience in Azure Data Engineering.
• Strong hands-on experience with Microsoft Fabric.
• Advanced SQL/T-SQL skills.
• Strong Python and PySpark experience.
• Strong knowledge of Lakehouse, Warehouse, OneLake, Delta Lake, and Medallion Architecture.
• Strong Power BI, DAX, semantic modeling, and Power Query skills.
• Experience with Direct Lake and Power BI performance optimization.
• Experience with Data Factory and Dataflows Gen2.
• Strong understanding of data modeling and performance tuning.
• Experience with Git, CI/CD, and deployment pipelines.
• Understanding of data security, governance, and monitoring.

Good to Have

• Hands-on experience building Microsoft Fabric Data Agents.
• Experience with Copilot, Azure OpenAI, MLflow, or MLOps.
• Knowledge of Microsoft Purview.
• Experience with Real-Time Intelligence, Eventstreams, Eventhouse, or KQL.
• Experience with Azure SQL, Snowflake, S3, or other external data sources.
• Microsoft Fabric/Azure Data Engineering certification.

Education

Bachelors degree in Computer Science, Information Technology, Data Engineering, or a related field.