ANAndor Tech
Big Data Developers
Bangalore ₹3-20 LPA Posted 4 Jun 2025
FULL TIME
Spark
Kafka
Sql
Nosql
Aws
+2 more
Job Description
- We are actively seeking skilled and experienced Big Data Developers to join our dynamic technology team
- As a Big Data Developer, you will play a key role in designing, developing, and maintaining scalable and high-performance data processing solutions
- If you have a strong background in Big Data technologies, a passion for data-driven solutions, and a desire to work on cutting-edge projects, we encourage you to apply
Responsibilities:
- Big Data Architecture: Design and implement robust and scalable Big Data solutions, considering factors such as performance, reliability, and security
- Data Processing: Develop efficient and high-performance data processing pipelines using Big Data technologies such as Apache Hadoop, Apache Spark, or Apache Flink
- Data Modeling: Design and implement data models for efficient storage and retrieval of large-scale datasets
- Optimize data structures for performance and scalability
- Integration: Collaborate with cross-functional teams, including data scientists, business analysts, and software engineers, to integrate Big Data solutions into end-to-end systems
- Performance Optimization: Identify and address performance bottlenecks in data processing and storage
- Implement optimizations to enhance overall system performance
- Real-time Data Processing: Work on real-time data processing solutions, leveraging technologies like Apache Kafka or other stream processing frameworks
- Data Security: Implement and adhere to security best practices in Big Data development, ensuring the confidentiality and integrity of sensitive data
- Troubleshooting and Debugging: Identify and resolve issues related to data processing, ensuring the reliability and accuracy of the data
- Documentation: Create and maintain comprehensive documentation for Big Data solutions, including architecture, design, and implementation details
- Continuous Learning: Stay updated on emerging trends and advancements in Big Data technologies
- Evaluate and recommend new tools and frameworks that can enhance our data processing capabilities