ES

Sr. Data Engineer

Esko
Bangalore14-26 LPA Posted 3 Sept 2025
FULL TIME
Adf
Pyspark
Notebooks
Python

Job Description

We are seeking a Senior Data Engineer with extensive experience in ETL and a strong focus on modern data architecture. The ideal candidate will be an expert in building enterprise-grade data solutions using Azure-native services and Microsoft Fabric. This role requires a professional who can architect, implement, and optimize data pipelines while ensuring data governance, quality, and security.

Key Responsibilities

  • Data Architecture & Implementation: Architect and implement enterprise-grade data solutions to modernize business intelligence (BI) and operationalize master data management (MDM) frameworks. Design, build, and optimize data pipelines using Microsoft Fabric and Azure Data Factory (ADF).
  • Data Governance & Quality: Establish and embed data governance, data quality, and MDM controls. Lead data migration strategies for cloud ERP systems, ensuring data integrity, lineage, and reconciliation.
  • Pipeline & Automation: Guide the transition from legacy SSIS/SQL Server workflows to automated, Fabric-based pipelines with CI/CD and GitOps practices. Enable data readiness for AI/ML and collaborate with data science teams to operationalize ML workloads.
  • Agile & Stakeholder Management: Drive agile delivery excellence through backlog shaping and sprint planning. Proactively identify risks and communicate clearly with both technical and non-technical stakeholders.

Required Qualifications

  • Experience: A total of 13 years of ETL experience, with a minimum of 5 years of hands-on experience in a similar role.
  • Technical Expertise: Deep expertise in Azure data engineering, including ADF, notebooks, PySpark, Python, and Microsoft Fabric.
  • A strong understanding and practical application of Medallion architecture, data modeling, and cloud-first design are essential.
  • Skills: Proven experience building CI/CD pipelines using tools like Azure DevOps. A background in SQL Server and SSIS, with a demonstrated ability to modernize to Azure/Fabric, is a must.
  • Attributes: Exceptional stakeholder management and communication skills. The ability to work independently, demonstrate accountability, and collaborate effectively.
  • Added Advantage: Working knowledge of Profisee (MDM) and familiarity with Microsoft Purview (data governance) is a plus.