SI

AWS Big Data Engineer

Siemens
Bangalore10-15 LPA Posted 30 Apr 2025
FULL TIME
Amazon Redshift
AWS Glue
Aws

Job Description

We are looking for Sr. AWS Cloud Architect

  • Architect and Design: Develop scalable and efficient data solutions using AWS services such as AWS Glue, Amazon Redshift, S3, Kinesis(Apache Kafka), DynamoDB, Lambda, AWS Glue(Streaming ETL) and EMR
  • Integration: Integrate real-time data from various Siemens organizations into our data lake, ensuring seamless data flow and processing.
  • Data Lake Management: Design and manage a large-scale data lake using AWS services like S3, Glue, and Lake Formation.
  • Data Transformation: Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
  • Snowflake Integration: Implement and manage data pipelines to load data into Snowflake, utilizing Iceberg tables for optimal performance and flexibility.
  • Performance Optimization: Optimize data processing pipelines for performance, scalability, and cost-efficiency.
  • Security and Compliance: Ensure that all solutions adhere to security best practices and compliance requirements.
  • Collaboration: Work closely with cross-functional teams, including data engineers, data scientists, and application developers, to deliver end-to-end solutions.
  • Monitoring and Troubleshooting: Implement monitoring solutions to ensure the reliability and performance of data pipelines. Troubleshoot and resolve any issues that arise.

You'd describe yourself as:

  • Experience: 8+ years of experience in data engineering or cloud solutioning, with a focus on AWS services.
  • Technical Skills: Proficiency in AWS services such as AWS API, AWS Glue, Amazon Redshift, S3, Apache Kafka and Lake Formation. Experience with real-time data processing and streaming architectures.
  • Big Data Querying Tools: Strong knowledge of big data querying tools (e.g., Hive, PySpark).
  • Programming: Strong programming skills in languages such as Python, Java, or Scala
  • for building and maintaining scalable systems.
  • Problem-Solving: Excellent problem-solving skills and the ability to troubleshoot complex issues.
  • Communication: Strong communication skills, with the ability to work effectively with both technical and non-technical stakeholders.
  • Certifications: AWS certifications are a plus.