EPEpsilon Data Management
Director, Software Engineering
Bangalore ₹10-15 LPA Posted 3 Jun 2025
FULL TIME
Spark
Spring Boot
Rest Apis
Java
Databricks
Job Description
Responsibilities
- Lead the design and implementation of an extensible integration platform to onboard and manage data from various systems.
- Architect and oversee data ingestion pipelines from external APIs, file-based sources, and event streams into the PeopleCloud using Databricks, Spark, and custom ETL services.
- Build reusable, scalable connector frameworks with monitoring, retry logic, and transformation capabilities.
- Ensure seamless integration with the PeopleCloud's APIs, data models, and customer-facing features.
- Drive backend development with Java/Spring Boot and real-time and batch data processing strategies.
- Oversee the frontend architecture (Angular) for internal tools and dashboards managing connectors, data flows, and transformation logic.
- Collaborate cross-functionally with product, data, and cloud infrastructure teams to align technical delivery with business goals.
- Ensure the platform is multi-cloud compatible, leveraging AWS, Azure, or GCP services where needed.
- Implement and maintain CI/CD pipelines, infrastructure as code, and blue-green deployment strategies for highly reliable releases.
Qualifications
- 10+ years in software engineering, with a strong foundation in backend systems and data engineering.
- 5+ years of leadership experience, including team building, mentoring, and delivery management.
- Expertise in Java, Spring Boot, REST APIs, and building cloud-native microservices.
- Strong understanding of data integration patterns, API consumption, and real-time/batch ETL.
- Experience building multi-connector frameworks is a big plus.
- Knowledge of Angular for front-end development and dashboarding.
- Proven experience with multi-cloud deployment, Kubernetes, Terraform, and observability tools.
- Experience with CI/CD pipelines and blue-green deployments in production environments.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Preferred Experience:
- Building integrations with systems like Salesforce, Workday, Marketo, Google Ads, Segment, Snowflake.
- Hands-on experience with Databricks, Spark, or equivalent data processing platforms.
- Strong understanding of data integration patterns, API consumption, and real-time/batch ETL.