Lead Consultant, HDP Data Engineer

Ready to build the future with AI
At Genpact, we don't just keep up with technology-we set the pace. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies' most complex challenges.
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what's possible, this is your moment.
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions - we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook.
Inviting applications for the role of Lead Consultant, HDP Data Engineer
HDP is an analytical big data warehouse based on Azure-Cloud-based data engineering pipelines. It is a Data Foundation for data-driven decision making: a harmonized subset of data from local & global sources, enabling local analytics and global products.
HDP Development (Dev) team is responsible for analysing data from sources and document findings about data as metadata. Other main responsibilities of the Dev team are to develop data engineering pipelines which are ingesting, transforming, and processing data from data sources and identify and develop data tests for tracking data quality in data pipelines.
Responsibilities
Pipeline Building:
Develop SQL based data processing pipelines which includes, but not limited, SQL functions, tables, and views
Data Validation:
.Create data validation rules on source data to confirm the data has correct and/or expected values.
Perform data profiling of source data (SAP datasets) to identify data quality issues and anomalies, business knowledge embedded in data, gathering of natural keys, and metadata information.
Data Validation Calls:
Interact with client stakeholders and inform about the mismatches observed during validation
Qualifications we seek in you!
Minimum Qualifications
.Strong SQL skills for data manipulation and query optimization
.Experience in basic python and PySpark Coding
.Good experience with version control - git system
.Knowledge of Azure Devops fundamentals
.Hands on experience on unified data analytics platform with Azure Databricks
.Experience of Data Build Tool (dbt) or Databricks Delta Live Table is a huge plus
.Knowledge of Visual Studio Code development is a plus
.Experience in data modelling, data integration and data quality
.Knowledge of data warehouse architectures, design patterns, and performance tuning techniques is a plus
.Customer/Stakeholder Focus
.Functional/Technical skills
.Written/Oral Communication
.Ability to adapt to different priorities and assignments quickly
.Team player with strong communication skills
.Excellent analytical and problem-solving skills
Preferred Qualifications/ Skills
.Bachelor's degree in computer science or related field
.Relevant years of relevant professional experience (mainly SQL)
.Relevant years' experience with python and Pyspark development
.Minimum years of experience in Azure Databricks platform

Why join Genpact
.Lead AI-first transformation - Build and scale AI solutions that redefine industries
.Make an impact - Drive change for global enterprises and solve business challenges that matter
.Accelerate your career-Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills
.Grow with the best - Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace
.Committed to ethical AI - Work in an environment where governance, transparency, and security are at the core of everything we build
.Thrive in a values-driven culture - Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.
Let's build tomorrow together.Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a %27starter kit,%27 paying to apply, or purchasing equipment or training.