Software Development Engineer II - Azure Data Engineering

Key Deliverables:

• Design and develop scalable data pipelines on Azure using Databricks and Data Factory
• Optimize Spark workloads and ETL processes for performance and reliability
• Enable ML workflows with data preparation, feature engineering, and pipeline integration
• Implement data quality checks, monitoring, and validation across structured and unstructured datasets

Role Responsibilities:

• Collaborate with engineering teams to support end-to-end data engineering use cases
• Work with large-scale datasets leveraging Delta Lake and Parquet formats
• Apply CI/CD and MLOps practices to ensure robust deployment of data workflows
• Contribute to model deployment, version control, and anomaly detection enhancements