AV

Lead Data Engineer

Avalara Technologies
Pune3-14 LPA Posted 11 Jun 2025
FULL TIME
Data Modeling
Sql
dbt
Airflow
Aws
+1 more

Job Description

What Your Responsibilities Will Be

  • You will Design, develop, and maintain efficient ETL pipelines using DBT,Airflow to move and transform data from multiple sources into a data warehouse.
  • You will Lead the development and optimization of data models (e.g., star, snowflake schemas) and data structures to support reporting.
  • You will Leverage cloud platforms (e.g., AWS, Azure, Google Cloud) to manage and scale data storage, processing, and transformation processes.
  • You will Work with business teams, marketing, and sales departments to understand data requirements and translate them into actionable insights and efficient data structures.
  • You will Use advanced SQL and Python skills to query, manipulate, and transform data for multiple use cases and reporting needs.
  • You will Implement data quality checks and ensure that the data adheres to governance best practices, maintaining consistency and integrity across datasets.
  • You will Experience using Git for version control and collaborating on data engineering projects.

What Youll Need to be Successful

  • Bachelors degree with 6+ years of experience in Data Engineering.
  • ETL/ELT Expertise : experience in building, improving ETL/ELT processes.
  • Data Modeling : experience with designing and implementing data models such as star and snowflake schemas, and working with denormalized tables to optimize reporting performance.
  • Experience with cloud-based data platforms (AWS, Azure, Google Cloud)
  • SQL and Python Proficiency : Advanced SQL skills for querying large datasets and Python for automation, data processing, and integration tasks.
  • DBT Experience : Hands-on experience with DBT (Data Build Tool) for transforming and managing data models.

Good to have Skills:

  • Familiarity with AI concepts such as machine learning (ML), (NLP), and generative AI. Work with AI-driven tools and models for data analysis, reporting, and automation.
  • Oversee and implement DBT models to improve the data transformation process.
  • Experience in the marketing and sales domain, with lead management, marketing analytics, and sales data integration.
  • Familiarity with business intelligence reporting tools, Power BI, for building data models and generating insights.