Data Engineering + Dot net Professional

Job Responsibilities

• Be the expert about the product within the team and assist the Lead and Engineering Manager on technical topics when required.
• Assist and mentor team members to perform their activities efficiently.
• Perform requirement understanding, generalize it, and convert it to development plan.
• Participate in design discussions, and code reviews.
• Build solutions which are efficient and can scale over huge data volumes in a reasonable timeframe.
• Act as a subject matter expert for focus areas across the technology space.
• Help identifying the dependencies, risks, and bottlenecks in the projects proactively. Work actively with the Engineering Manager to resolve them.
• Actively contribute to:
• The breaking down of releasable pieces of value
• Identification of measurements of success including DOD (definition of done)
• Demonstration of business value in frequent ceremonies
• Living documentation of the domain and platform you operate in allows knowledge sharing and distribution

Required Skills

• 5+ years of experience in distributed computing (Spark) and software development
• 3+ years of experience in Spark-Scala
• 5+ years of experience in Data Engineering
• 5+ years of experience in Python
• Fluency in working with databases (preferably Postgres)
• Sound understanding of Object Oriented Programming and development principles
• Experience working in an Agile Scrum or Kanban development environment
• Experience working with version control software (preferably Git)
• Experience with CI/CD pipelines
• Experience with automated testing including integration/delta, Load and Performance

Good to Have Skills

• Experience of working with Docker and Containers
• Experience of working with Kubernetes
• Experience of working with Airflow
• Experience of working on Cloud environments (GCP and Azure)
• Experience of working with TeamCity CI and Octopus Deploy