Databricks Engineer

Key Responsibilities

• Develop, optimize, and maintain ETL/ELT pipelines using Databricks and Azure Data Factory.
• Write clean, efficient, and reusable Python code for data transformation and processing.
• Work with large datasets to ensure performance, reliability, and scalability.
• Integrate data from multiple sources into Azure-based data platforms.
• Monitor, troubleshoot, and resolve data pipeline failures and performance issues.
• Support deployment, testing, and maintenance of data workflows.
• Ensure best practices in data engineering, security, and documentation are followed.