Azure Databricks

• 
  
• Experience in building ETL / data warehouse transformation processes Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks)
• Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala) Evaluating the performance and applicability of multiple tools against customer requirements Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
• Coding complex U-SQL, Spark (Scala or Python). T-SQL Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)

Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse