Spark developer

Job Summary:

The Spark Developer is responsible for designing and developing big data applications using Apache Spark and related technologies. This role involves working on large-scale data processing, real-time analytics, and building efficient data pipelines for various business use cases.

Key Responsibilities:

• Design and implement scalable data processing solutions using Apache Spark
• Develop data pipelines and ETL workflows for batch and streaming data
• Optimize Spark applications for performance and resource usage
• Integrate Spark jobs with Hadoop, Hive, Kafka, and other big data technologies
• Collaborate with data engineers, analysts, and architects to meet data processing requirements
• Write clean, maintainable, and well-documented code
• Debug and troubleshoot data processing issues in production
• Participate in code reviews and follow Agile development practices