Data Engineer-Data Platforms-Azure

Key Responsibilities:

• Design, develop, and maintain robust data pipelines and ETL processes using Azure services.
• Work with Azure Data Factory, ADLS (Azure Data Lake Store), and Databricks to manage and process data efficiently.
• Utilize PySpark, PL/SQL, and Spark SQL for programming and data transformations.
• Implement and maintain relational and NoSQL databases, including Postgres and Cassandra.
• Develop solutions leveraging Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, and serverless architecture.
• Collaborate with cross-functional teams to ensure data solutions meet business requirements and maintain high performance.
• Stay current with Azure technology advancements and data engineering best practices.