Python pyspark adb adf

• experience in designing large data distribution, integration with service-oriented architecture and/or data warehouse solutions, Data Lake solution using Azure Databricks with large and multi-format data
• ability to translate working solution into implementable working package using Azure platform
• good understanding on Azure storage Gen2
• hands on experience with Azure stack (minimum 5 years)

+ Azure Databricks

+ Azure Data Factory

+ Azure DevOps

• proficient coding experience using Spark (Scala/Python), T-SQL
• understanding around the services related to Azure Analytics, Azure SQL, Azure function app, logic app
• prior ETL development experience using industry tool e.g. informatica/SSIS/Talend etc.
• good to have knowledge in Kafka streaming Azure Infrastructure
• a proven track of work experience in cloud deployments (MS Azure preferred) in an agile SDLC environment, leveraging modern programming languages, DevOps, SQL and noSQL databases, and test-driven development.