Data Engineer-Data Integration

Key Responsibilities:

Data Engineering & Integration:

• Design, develop, and maintain ETL processes using Ab Initio tools.
• Write, test, and deploy Ab Initio graphs, scripts, and other necessary components.
• Extract, transform, and load data from diverse sources into data warehouses, operational data stores, or other target systems.
• Work with structured, semi-structured, and unstructured data formats.

Predictive Modeling & Analytics:

• Implement and validate predictive models.
• Create and maintain statistical and machine learning models with a focus on big data applications.

Enterprise Search & Data Applications:

• Design and implement enterprise search applications using tools such as Elasticsearch and Splunk to meet client requirements.

Collaboration & Agile Practices:

• Work in an Agile, collaborative environment alongside scientists, engineers, consultants, and database administrators.
• Develop reusable data pipelines and applications, ensuring data quality and performance.

Troubleshooting & Optimization:

• Identify, troubleshoot, and resolve data processing issues.
• Optimize data workflows and improve overall performance.

Client Communication:

• Communicate with internal and external stakeholders to understand business needs and deliver analytical solutions.
• Present results to technical and non-technical audiences.