Azure Data Engineer

Job Summary:

• Join a high-performing team building and integrating modern data solutions on the latest technology stack.
• Deliver reusable components and scalable frameworks enabling fast ingestion and curation of analytical datasets.
• Hands-on development role with full lifecycle involvement from coding to production deployment.

Key Responsibilities:

Development & Delivery

• Hands-on coding and delivery of robust data engineering solutions.
• End-to-end development from inception to production.
• Partner with 3rd-party developers to ensure timely, high-quality code delivery.

Project Execution

• Deliver on complex, distributed data engineering projects.
• Collaborate with internal teams and ensure requirements are fully met.
• Escalate risks and issues as necessary in a timely manner.

Agile & DevOps

• Adopt agile methodologies (DABL – Discovery, Alpha, Beta, Launch).
• Operate within product-centric, DevOps-enabled teams.
• Contribute to continuous integration and delivery processes.

Ownership & Governance

• Take ownership of development tasks and steer to completion.
• Maintain risk and issue logs with defined mitigation plans and accountable owners.

Innovation & Forward Planning

• Stay current with new technologies in analytics and data engineering.
• Suggest innovations and improvements for existing platforms and services.

Architecture & Collaboration

• Engage in architectural discussions with architects and tech leads.
• Understand technical frameworks and ensure alignment with enterprise architecture.

Quality, Risk & Compliance

• Ensure project governance and compliance with security and regulatory requirements.
• Manage risks with clear mitigation strategies and action owners.

Required Qualifications & Skills:

• Bachelor's/Master's degree in Computer Science, Engineering, or Data Science.
• 5–8 years of hands-on data engineering experience.
• Proficient in Python, SQL, Scala.
• Experience with Azure data stack: Databricks, Data Factory, SQL DW, Cosmos DB, Power BI, Power Apps.
• Knowledge of tools like Ataccama, Talend, Collibra, Snowflake, StreamSets.
• Strong knowledge of Spark, Databricks, Delta Lake, and big data architecture.
• Experience with Agile methodologies and tools: SAFe, Jira, Confluence, Azure DevOps.
• Skilled in data visualization and dashboard development.
• Capable of scaling analytics solutions from MVP to production.
• Excellent communication skills for both technical and non-technical stakeholders.
• Strong collaboration skills across IT (security, infra, compliance) and business functions.
• Experience managing external vendors and technology partners.