SISiemens
Data Engineer ( AWS, Confluent & SnapLogic )
Bangalore ₹3-6 LPA Posted 21 May 2025
FULL TIME
workflow management
Data Modelling
Sql
Aws
Python
Job Description
We are looking for Data Engineer ( AWS, Confluent & Snaplogic )
- Data Integration Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching.
- Data Processing Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading.
- Data Storage Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval.
- Data Transformation Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
- Data Products Create and maintain data products that meet the needs of various stakeholders, providing actionable insights and supporting data-driven decision-making.
- Workflow Management Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and accurate data processing.
- Real-time Data Streaming Utilize Confluent Kafka for real-time data streaming, ensuring low-latency data integration and processing.
- ETL Processes Design and implement ETL processes using SnapLogic , ensuring efficient data extraction, transformation, and loading.
- Monitoring and Logging Use Splunk for monitoring and logging data processes, ensuring system reliability and performance.
- You'™d describe yourself as:
- Experience 3+ relevant years of experience in data engineering, with a focus on AWS Glue, Iceberg tables, Confluent Kafka, SnapLogic, and Airflow.
Technical Skills :
- Proficiency in AWS services, particularly AWS Glue.
- Experience with Iceberg tables and Snowflake.
- Knowledge of Confluent Kafka for real-time data streaming.
- Familiarity with SnapLogic for ETL processes.
- Experience with Apache Airflow for workflow management.
- Understanding of Splunk for monitoring and logging.
- Programming Skills Proficiency in Python, SQL, and other relevant programming languages.
- Data Modeling Experience with data modeling and database design.
- Problem-Solving Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues.