Azure Databricks

Databricks Lead

Key skills – Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL)

Must-have skills

·      6+ years of experience required for this role

Cloud certified in one of these categories

Azure Data Engineer

Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation

Semantic Modelling/ Optimization of data model to work within Rahona

Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.

Experience in Sqoop / Hadoop

Microsoft Excel (for metadata files with requirements for ingestion)

Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud

Strong Programming skills with at least one of Python, Scala or Java

Strong SQL skills ( T-SQL or PL-SQL)

Data files movement via mailbox

Source-code versioning/promotion tools, e.g. Git/Jenkins

Orchestration tools, e.g. Autosys, Oozie

Source-code versioning with Git.

Nice-to-have skills

Experience working with mainframe files

Experience in Agile environment, JIRA/Confluence tools