Azure Databricks Engineer

Key Responsibilities:

• Data Pipeline Development: Develop and maintain robust data pipelines using Azure Databricks and Azure Data Factory (ADF) for structured and semi-structured data sources.
• Data Optimization: Optimize performance of data pipelines and ensure high data quality.
• Collaboration: Work closely with cross-functional teams to support data integration, analytics use cases, and reporting requirements.
• Data Integration Support: Assist in integrating various data sources into a unified analytics environment.
• Performance Monitoring: Continuously monitor data pipelines for reliability, efficiency, and scalability.