bigdata,azure databricks

Roles & Responsibilities:

• Tot - 6+ yrs
• Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment
• Participate in design and implementation of the analytics architecture.
• Experience in working on Hadoop Distribution, good understanding of core concepts and best practices
• Good experience in building/tuning Spark pipelines in Python/Java/Scala
• Good experience in writing complex Hive queries to drive business critical insights
• Understanding of Data Lake vs Data Warehousing concepts
• Experience with AWS Cloud, exposure to Lambda/EMR/Kinesis will be good to have