DEDeloitte Consulting India Private Limited
Manager | Data Engineering |
Delhi ₹6-8 LPA Posted 9 Apr 2025
FULL TIME
Power Bi
Tableau
Aws
Job Description
Key Responsibilities:
- Lead, mentor, and manage a team of data engineers, providing guidance, training, and fostering an environment of continuous improvement.
- Design, develop, and maintain robust data pipelines and data infrastructure to support business intelligence, data analytics, and machine learning initiatives.
- Collaborate with cross-functional teams (e.g., Data Science, Product, IT) to define data requirements, ensure data availability, and optimize data flows.
- Oversee the architecture and optimization of large-scale data storage solutions (e.g., data lakes, data warehouses) in cloud platforms such as AWS, Azure, or Google Cloud.
- Manage the creation of automated processes for data ingestion, transformation, and storage, ensuring data integrity, quality, and performance.
- Lead efforts to improve data security, governance, and compliance practices for all data assets.
- Stay current with emerging technologies and trends in data engineering, making recommendations for the adoption of new tools and technologies.
- Drive the evolution of the data engineering strategy, aligning with business objectives and technical requirements.
- Manage the day-to-day operations of the data engineering team, ensuring timely delivery of data solutions and projects.
- Design and implement monitoring, logging, and alerting systems to ensure data pipelines and infrastructure are running efficiently.
- Collaborate with the data architecture team to design and implement scalable data architectures that support the organization's long-term goals.
- Lead performance tuning and optimization of data systems to improve the speed, reliability, and scalability of data processing.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field.
- Minimum of [X] years of experience in data engineering, with at least [Y] years in a managerial or leadership role.
- Strong experience with cloud platforms such as AWS, Google Cloud, or Microsoft Azure, and their data engineering services (e.g., S3, Redshift, BigQuery, etc.).
- Proficiency in data processing technologies like Apache Spark, Hadoop, Kafka, or other ETL tools.
- Expertise in programming languages such as Python, Java, or Scala, with experience in building and maintaining data pipelines.
- Experience with SQL and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB).
- Knowledge of data warehousing, data lakes, and ETL processes.
- Familiarity with data modeling, data governance, and data quality practices.
- Experience with containerization and orchestration tools such as Docker and Kubernetes is a plus.
- Proven experience managing and scaling data engineering teams in a fast-paced environment.
- Strong problem-solving and analytical skills, with a track record of delivering innovative data solutions.
Skills and Competencies:
- Leadership: Ability to manage and inspire a high-performing data engineering team.
- Communication: Excellent communication skills, both written and verbal, with the ability to interact with stakeholders across technical and non-technical teams.
- Collaboration: Strong interpersonal skills with a collaborative mindset, working closely with other teams such as data science, business intelligence, and software engineering.
- Project Management: Experience managing multiple data engineering projects simultaneously, with a focus on delivery, quality, and timelines.
- Problem-Solving: Strong troubleshooting skills with the ability to resolve complex data-related challenges.
- Business Acumen: Ability to understand business needs and translate them into technical solutions that provide measurable business value.
Preferred Experience:
- Experience with machine learning workflows or data science pipelines.
- Knowledge of streaming data platforms (e.g., Apache Flink, Apache Storm).
- Experience with CI/CD pipelines and automated testing for data engineering projects.
- Familiarity with data visualization tools (e.g., Tableau, Power BI) or experience working with business intelligence teams.
- Previous experience in the Telecommunications or Technology (T&T) sector is a plus.