SI

Data Engineer ( AWS, Confluent & SnapLogic )

Siemens
Bangalore3-6 LPA Posted 21 May 2025
FULL TIME
workflow management
Data Modelling
Sql
Aws
Python

Job Description

We are looking for Data Engineer ( AWS, Confluent & Snaplogic ) 

  •  Data Integration Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching.
  •  Data Processing Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading.
  •  Data Storage Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval.
  •  Data Transformation Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
  •  Data Products Create and maintain data products that meet the needs of various stakeholders, providing actionable insights and supporting data-driven decision-making.
  •  Workflow Management Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and accurate data processing.
  •  Real-time Data Streaming Utilize Confluent Kafka for real-time data streaming, ensuring low-latency data integration and processing.
  •  ETL Processes Design and implement ETL processes using SnapLogic , ensuring efficient data extraction, transformation, and loading.
  •  Monitoring and Logging Use Splunk for monitoring and logging data processes, ensuring system reliability and performance.
  •  You'™d describe yourself as: 
  •  Experience 3+ relevant years of experience in data engineering, with a focus on AWS Glue, Iceberg tables, Confluent Kafka, SnapLogic, and Airflow.

 Technical Skills :

  • Proficiency in AWS services, particularly AWS Glue.
  • Experience with Iceberg tables and Snowflake.
  • Knowledge of Confluent Kafka for real-time data streaming.
  • Familiarity with SnapLogic for ETL processes.
  • Experience with Apache Airflow for workflow management.
  • Understanding of Splunk for monitoring and logging.
  •  Programming Skills Proficiency in Python, SQL, and other relevant programming languages.
  •  Data Modeling Experience with data modeling and database design.
  •  Problem-Solving Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues.
Join WhatsApp Channel