Azure Databricks

We are seeking an experienced Azure Databricks professional to join our team in India. The ideal candidate will have a strong background in data engineering, particularly with Azure Databricks, and will play a key role in designing and implementing data processing solutions.

Responsibilities:

• Design and implement data processing pipelines using Azure Databricks.
• Collaborate with data engineers and data scientists to ensure data availability and quality.
• Optimize performance of data processing jobs and troubleshoot issues as they arise.
• Develop and maintain documentation related to data workflows and architecture.
• Participate in code reviews and contribute to best practices in data engineering.

Skills and Qualifications:

• 4-9 years of experience in data engineering or related field.
• Strong proficiency in Azure Databricks and Spark.
• Experience with data modeling and ETL processes.
• Proficiency in programming languages such as Python, Scala, or SQL.
• Familiarity with Azure Data Lake, Azure SQL Database, and Azure DevOps.
• Knowledge of data warehousing concepts and technologies.
• Experience with version control systems like Git.