BM

Data Ops Lead Software Engineer

Bmw Techworks India
Bangalore7-10 LPA Posted 22 Aug 2025
FULL TIME
snowflake
React
S3
Rest Apis
Azure
+1 more

Job Description

Responsibilities :

  • Design, develop, and maintain backend services and APIs in Python to enable self-service pipeline creation, orchestration, and monitoring.
  • Build frontend features (e.g., dashboards, forms, monitoring views) that help customers easily design and manage data pipelines.
  • Develop frameworks, templates, and tooling using AWS services (Glue, Lambda, Step Functions) to support scalable, secure ETL/ELT workflows.
  • Integrate AWS services (S3, Glue, IAM) to deliver secure and reliable data movement and cataloging.
  • Implement robust monitoring, validation, and alerting features to ensure data quality, integrity, and lineage across customer pipelines.
  • Enable connectivity and integrations with external systems such as Snowflake, Azure, and SAP.
  • Collaborate closely with UX designers and other engineers to deliver intuitive, well-documented user experiences.
  • Participate in architecture discussions, sprint planning, code reviews, and CI/CD workflows.

What should you bring along

Requirements :

  • Strong experience with Python for backend development, ideally in a cloud-native, serverless context.
  • Proficiency with frontend development in frameworks such as React, Vue, or Angular.
  • Solid understanding of AWS services (Glue, S3, Lambda, IAM, Step Functions) and their use in data workflows.
  • Experience designing and consuming REST APIs.
  • Familiarity with data engineering concepts like data modeling, schema evolution, and partitioning strategies for large-scale storage.
  • Proven ability to build shared tools, libraries, or frameworks that enable other engineers or customers to work more effectively.
  • Commitment to writing well-tested, maintainable code, with experience in unit and integration testing.
  • Familiarity with version control (Git) and CI/CD best practices.
  • Strong communication skills and a collaborative, customer-focused mindset.

Must have technical skills

  • Python, ideally in a cloud-native, serverless context
  • React, Vue, or Angular
  • AWS services Glue, S3, Lambda, IAM, Step Functions
  • REST APIs
  • Data engineering concepts like data modeling, schema evolution, and partitioning strategies
  • GitHub

Good to have technical skills

  • Experience integrating with Snowflake, Azure, or SAP systems.
  • Familiarity with Glue Data Catalog, AWS Secrets Manager, or other security best practices.
  • Experience building data quality monitoring dashboards or developer tooling for pipeline management.
  • Experience with Infrastructure as Code tools such as Terraform for managing AWS resources

Join WhatsApp Channel