Azure Data Engineer

• Create and maintain data pipelines that efficiently move data from various sources to storage and processing systems
• Extract, transform, and load (ETL) data using tools like Azure Data Factory
• Work with Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, and Azure Blob Storage to design scalable and performant data storage solutions
• Use technologies like Azure Databricks and Apache Spark to process and analyze large volumes of data
• Implement data governance procedures and ensure compliance with security policies

Skills:

• Proficiency in SQL and other data query languages
• Experience with Azure data storage solutions
• Knowledge of data integration tools
• Familiarity with data processing frameworks
• Understanding of data modeling and schema design principles
• Ability to work with large datasets and perform data analysis
• Strong problem-solving and troubleshooting skills

Etl, Azure Cosmo Db, Spark, Python, Sql, Azure, Data Engeneering