Cloudera Developer

 Job Description

External Description

Spark development with batch and streaming experience

Experience with Pyspark and Data Engineering

ETL implementation and migration to spark

Programming knowledge on scala, java & python

Experience with kafka and Spark streaming (Dstream and Structured Streaming)

Experience with using Jupyter notebooks or any other developer tool

Flink and Kudu streaming

Informatica workflow migration

Automation of workflows CI/CD

Nifi streaming and transformation

Experience with Airflow or other workflow engines.

External Skills And Expertise

Cloudera experience

Flink and Kudu streaming

Informatica workflow migration

Automation of workflows CI/CD

Nifi streaming and transformation

Experience with Airflow or other workflow engines

7-8 years experience as a Spark Developer