Azure Bigdata Specialist

Must Have Skills:

• Azure Databricks (ADB): Extensive experience working with Databricks, Delta Lake, and Azure Data Lake Storage (ADLS).
• Azure Data Factory (ADF): Experience in building ELT/ETL pipelines in a Spark-based environment.
• SQL and Databases: Proficiency with Azure SQL Database (SQL DB) and strong SQL skills.
• Spark & PySpark: Extensive experience with SparkCore, PySpark, SparkSQL, Scala.
• Data Storage: Hands-on experience with Azure Blob Storage and Delta Lake.
• Real-Time Data Processing: Experience in Apache Kafka, EventHub, IoT, Structured Streaming, and Stream Analytics.
• ELT Orchestration: Familiarity with Apache Airflow for managing ELT workflows.
• Infrastructure Management: Experience with Infrastructure as Code (IaC) using tools like Terraform.
• CI/CD & Version Control: Experience with CI/CD pipelines, version control tools like GitHub, and Azure DevOps.

Good to Have:

• Containerization: Knowledge of Docker and Kubernetes.
• Agile Methodology: Experience working in Agile environments.

Qualifications:

• Education: BE, MS, M.Tech, or MCA.

Certifications (Preferred):

• Azure Big Data certification.
• Databricks Certified Associate