Data Engineer

Key Responsibilities

• Design, develop, and maintain scalable data pipelines on AWS cloud platform
• Work with Databricks and Apache Spark for large-scale data processing
• Write and optimize SQL queries for relational and analytical databases
• Develop data transformation, cleansing, and aggregation workflows using Python
• Implement and manage AWS services including Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, and IAM
• Work on real-time analytics frameworks and support streaming data use cases
• Collaborate with business intelligence teams for analytics development
• Troubleshoot production issues, monitor data pipelines, and ensure performance optimization
• Work with Unix/Linux environments for script automation and job scheduling
• Support large-scale enterprise data projects from design to deployment