Azure Data Engineer

Responsibilities:

• Azure Data Solutions Development: Design, develop, and maintain scalable and efficient data solutions primarily leveraging Azure Databricks and Azure SQL.
• Data Pipeline Construction: Build robust ETL/ELT data pipelines using Azure services, ensuring data quality, reliability, and efficient data flow.
• Python Development: Utilize Python for data manipulation, scripting, automation, and building data processing applications.
• Data Modeling & Warehousing: Work with data modeling concepts and contribute to the design and implementation of data warehouses and data lakes on Azure.
• Performance Optimization: Optimize data processes and queries for performance and cost efficiency within the Azure environment.
• Troubleshooting: Identify, troubleshoot, and resolve issues related to data pipelines, data quality, and Azure data services.
• Collaboration: Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver effective data solutions.
• Documentation: Create and maintain technical documentation for data pipelines, processes, and solutions.

Required Skills:

• Proficiency in Azure Databricks.
• Proficiency in Azure SQL.
• Strong programming skills in Python.
• Strong understanding of data engineering principles and methodologies.
• Ability to design, develop, and troubleshoot complex data pipelines.
• Knowledge of data warehousing concepts.