DBT / DataStage

We are seeking a skilled and experienced DBT (Data Build Tool) / DataStage Developer to design, develop, and maintain robust data transformation and integration solutions. The ideal candidate will have hands-on expertise with either DBT for data modeling in data warehouses or IBM DataStage for ETL processes, coupled with a strong understanding of data warehousing concepts. This role is crucial for building and optimizing our data pipelines, ensuring data quality, and supporting analytical initiatives.

Roles and Responsibilities:

• Design, develop, and implement data transformation logic using either DBT (Data Build Tool) for data modeling within data warehouses (e.g., Snowflake, BigQuery, Redshift) or IBM DataStage for complex ETL (Extract, Transform, Load) processes.
• Create, maintain, and optimize data pipelines to ensure efficient and reliable data flow from source systems to target data platforms.
• Write, test, and deploy SQL-based data transformations using DBT, ensuring data integrity and performance.
• For DataStage, develop and fine-tune DataStage jobs, sequences, and routines for data extraction, transformation, and loading.
• Collaborate with data architects, data engineers, and business analysts to understand data requirements and translate them into technical solutions.
• Perform data profiling, data quality checks, and validation to ensure accuracy and consistency of data.
• Troubleshoot and resolve data pipeline issues, performance bottlenecks, and data discrepancies.
• Implement and maintain version control for data models and ETL jobs.
• Contribute to the development of data governance and data quality standards.
• Create and maintain comprehensive technical documentation for data models, ETL processes, and data flows.
• Participate in code reviews and provide constructive feedback to peers.

Required Skills and Qualifications:

• Proven experience as a Data Engineer / Developer with a focus on data transformation.
• Strong expertise in either DBT (Data Build Tool) for data modeling and transformation in modern data warehouses OR extensive experience with IBM DataStage for enterprise-level ETL.
• Solid understanding of data warehousing concepts, dimensional modeling, and ETL/ELT methodologies.
• Highly proficient in SQL (Structured Query Language) for complex data manipulation and querying.
• Experience with cloud data platforms like Snowflake, Google BigQuery, or Amazon Redshift (if DBT focused).
• Familiarity with version control systems (e.g., Git).
• Strong analytical and problem-solving skills with attention to detail.
• Excellent communication skills (written and verbal) and ability to work collaboratively in a team environment.
• Knowledge of scripting languages (e.g., Python) is a plus.