Bigdata Developer

We are actively seeking a highly skilled Big Data Developer to join our client's team through Acme Services. This role is crucial for designing, developing, and implementing robust big data solutions within a complex ecosystem. The ideal candidate will possess a good understanding of the Hadoop ecosystem, familiarity with Cloudera/Hortonworks distributions, and excellent knowledge of ETL pipelines, database, and reporting model design. In-depth and working knowledge of Spark, Hive, NiFi, Kafka, and Hadoop commands is essential, along with experience in DevOps implementation and hands-on proficiency with Python/Scala/Java.

Key Responsibilities

• Big Data Ecosystem Management: Apply a good understanding of the Hadoop ecosystem and familiarity with Cloudera/Hortonworks distributions to manage and optimize big data environments.
• ETL Pipeline Development: Design and implement robust ETL pipelines, ensuring efficient data ingestion, transformation, and loading processes.
• Data Modeling & Reporting: Leverage excellent knowledge of database & reporting model design to create scalable and performant data structures for analytics and reporting.
• Big Data Tooling: Utilize in-depth & working knowledge of Spark, Hive, NiFi, Kafka, and Hadoop commands for data processing, streaming, and orchestration.
• DevOps Implementation: Contribute to and support DevOps implementation efforts for big data solutions, enhancing continuous integration and deployment.
• Programming & Scripting: Develop and maintain big data applications and scripts using Python, Scala, or Java.
• Troubleshooting & Optimization: Identify and resolve performance bottlenecks and technical issues within the big data ecosystem.

Skills

• Good understanding of the Hadoop ecosystem.
• Familiarity with Cloudera/Hortonworks distribution.
• Excellent knowledge of ETL pipelines, Database & Reporting model design.
• In-depth & working knowledge of Spark, Hive, NiFi, Kafka, and Hadoop commands.
• Experience in DevOps implementation.
• Hands-on proficiency with Python/Scala/Java.

Qualifications

• Proven experience as a Big Data Developer.
• Demonstrable expertise across the specified big data technologies and concepts.
• Ability to design and implement complex data solutions.
• Strong problem-solving and analytical skills.