ES
Job Description
We are seeking a Senior Data Engineer with extensive experience in ETL and a strong focus on modern data architecture. The ideal candidate will be an expert in building enterprise-grade data solutions using Azure-native services and Microsoft Fabric. This role requires a professional who can architect, implement, and optimize data pipelines while ensuring data governance, quality, and security.
Key Responsibilities
- Data Architecture & Implementation: Architect and implement enterprise-grade data solutions to modernize business intelligence (BI) and operationalize master data management (MDM) frameworks. Design, build, and optimize data pipelines using Microsoft Fabric and Azure Data Factory (ADF).
- Data Governance & Quality: Establish and embed data governance, data quality, and MDM controls. Lead data migration strategies for cloud ERP systems, ensuring data integrity, lineage, and reconciliation.
- Pipeline & Automation: Guide the transition from legacy SSIS/SQL Server workflows to automated, Fabric-based pipelines with CI/CD and GitOps practices. Enable data readiness for AI/ML and collaborate with data science teams to operationalize ML workloads.
- Agile & Stakeholder Management: Drive agile delivery excellence through backlog shaping and sprint planning. Proactively identify risks and communicate clearly with both technical and non-technical stakeholders.
Required Qualifications
- Experience: A total of 13 years of ETL experience, with a minimum of 5 years of hands-on experience in a similar role.
- Technical Expertise: Deep expertise in Azure data engineering, including ADF, notebooks, PySpark, Python, and Microsoft Fabric.
- A strong understanding and practical application of Medallion architecture, data modeling, and cloud-first design are essential.
- Skills: Proven experience building CI/CD pipelines using tools like Azure DevOps. A background in SQL Server and SSIS, with a demonstrated ability to modernize to Azure/Fabric, is a must.
- Attributes: Exceptional stakeholder management and communication skills. The ability to work independently, demonstrate accountability, and collaborate effectively.
- Added Advantage: Working knowledge of Profisee (MDM) and familiarity with Microsoft Purview (data governance) is a plus.