Full Stack Data/ML Engineer

 Job Description

· Proactively drive data science engineering projects forward with a self-motivated and go-getter attitude, effectively navigating ambiguity and managing at-times incomplete requirements.

· Build on top of and utilize Azure Cloud or AWS platforms, leveraging familiarity with components such as IAM, storage, compute, services, and application development.

· Develop, maintain, and optimize Python code bases to ensure performance, readability, and adherence to code standards like PEP8, including implementing comprehensive test coverage.

· Design, develop, and deploy scalable and performant Python web services and APIs for diverse architectures, including synchronous and asynchronous REST APIs.

· Implement and maintain event-driven product architectures and batch processing systems to support scalable and efficient data processing.

· Develop and deploy LLM-based and GenAI applications using tools and frameworks such as OpenAI, HuggingFace Transformers, LlamaIndex, and vector stores/databases like Chroma, FAISS, Qdrant, and Weaviate.

· Utilize the Elastic stack (Elastic, Logstash, Kibana) and Databricks for data processing and analytics as preferred.

· Effectively use version control, containerization, CI/CD pipelines, and the deployment of applications on Azure using Git and Docker.

· Manage SQL databases, such as PostgreSQL, ensuring efficient backend operations and data integrity.

· Collaborate effectively with cross-functional teams, including data scientists, engineers, and architects, to build and release data and AI applications.

· Communicate clearly and effectively in English, facilitating interactions and collaboration within a globally distributed and diverse data science and engineering team.

SKILLS

· Utilize distributed data processing frameworks such as Apache Spark, Apache Dask, and Databricks.

· Implement logging and monitoring using Azure Log Analytics, Monitor, or Prometheus.

· Manage the development lifecycle, including code development, testing, and deployment to production environments.

· Apply parallel processing and concurrency paradigms in Python and .NET (desirable).

· Develop basic front-ends with JavaScript/TypeScript and frameworks like React or Vue (desirable).

· Proficient in a statically typed language such as C# .NET or Java (desirable).

PROFESSIONAL EXPERIENCE/QUALIFICATIONS

· 5-6 years of development and back-end engineering experience, and at least a year of experience in shipping production-grade codebases.

· Bachelor's (B.E., B. Tech) or Masters (M.E, MTech) in computer science or software engineering is required.