Databricks / aws Expert

Roles & Responsibilities:

• Lead design and development of cloud-based data engineering solutions using Databricks on AWS.
• Build and maintain scalable data pipelines for processing large datasets.
• Develop data processing applications using Scala, PySpark, Python, and Databricks SQL.
• Work on AWS cloud services for data integration, storage, and processing.
• Collaborate with client architecture and design teams to understand requirements and define technical solutions.
• Gather business requirements and translate them into technical design and development tasks.
• Implement Data Engineering best practices along with DevOps and DataOps workflows.
• Participate in Agile development lifecycle including sprint planning and delivery.
• Support offshore/onshore coordination and ensure timely delivery of solutions.
• Optimize data pipelines for performance, scalability, and reliability.
• Work in financial domain projects ensuring compliance and data accuracy.
• Provide technical guidance and mentorship to development teams.