IT Architect (Data Engineer)

As an IT Architect (Data Engineer) at Medtronic's new Minimed India Hub, you will be crucial in designing, developing, and maintaining robust data pipelines using PySpark. You'll work with diverse stakeholders to ensure the efficient processing and analysis of large datasets, driving our mission to improve healthcare access and equity through innovative digital solutions.

A Day in the Life

You will contribute to Medtronic's digital transformation by:

• Designing, developing, and maintaining scalable and efficient ETL pipelines using PySpark.
• Working with structured and unstructured data from various sources.
• Optimizing and tuning PySpark applications for performance and scalability.
• Collaborating with data scientists and analysts to understand data requirements, review Business Requirement documents, and deliver high-quality datasets.
• Implementing data quality checks and ensuring data integrity.
• Monitoring and troubleshooting data pipeline issues, ensuring timely resolution.
• Documenting technical specifications and maintaining comprehensive documentation for data pipelines.
• Staying up to date with the latest trends and technologies in big data and distributed computing.

Required Knowledge and Experience

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 4-5 years of experience in data engineering, with a focus on PySpark.
• Proficiency in Python and Spark, with strong coding and debugging skills.
• Strong knowledge of SQL and experience with relational databases (e.g., PostgreSQL, MySQL, SQL Server).
• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
• Experience with data warehousing solutions like Redshift, Snowflake, Databricks, or Google BigQuery.
• Familiarity with data lake architectures and data storage solutions.
• Experience with big data technologies such as Hadoop, Hive, and Kafka.
• Excellent problem-solving skills and the ability to troubleshoot complex issues.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Preferred Skills

• Experience with Databricks.
• Experience with orchestration tools like Apache Airflow or AWS Step Functions.
• Knowledge of machine learning workflows and experience working with data scientists.
• Understanding of data security and governance best practices.
• Familiarity with streaming data platforms and real-time data processing.
• Knowledge of CI/CD pipelines and version control systems (e.g., Git).

Benefits & Compensation

Medtronic offers a competitive Salary and flexible Benefits Package. We are committed to our employees, recognizing their contributions and providing resources to support you at every career and life stage. This position is eligible for the Medtronic Incentive Plan (MIP).

About Medtronic

Medtronic leads global healthcare technology, boldly attacking the most challenging health problems facing humanity by searching out and finding solutions. Our Mission to alleviate pain, restore health, and extend life unites a global team of 95,000+ passionate people. We are engineers at heart, putting ambitious ideas to work to generate real solutions for real people, leveraging talent, diverse perspectives, and courage to engineer the extraordinary.