Staff Data Engineer

Roles and Responsibilities:

• Data Pipeline Development: Build and maintain scalable ETL/ELT pipelines using PySpark for analytics and reporting.
• Analytics-Ready Datasets: Design datasets optimized for reporting, dashboards, and self-service consumption by business teams and data scientists.
• Self-Service Enablement: Implement semantic layers, catalogues, and APIs to enable consumption without deep pipeline knowledge.
• Metrics & Reporting: Partner with stakeholders to translate business questions into clear, accurate metrics and dashboards.
• Data Accuracy & Quality: Ensure data accuracy, freshness, and consistency across reporting surfaces through testing, documentation, and quality checks.
• Cloud & DevOps Practices: Apply CI/CD, DevOps, and cloud-based data engineering best practices for high-volume, highly available pipelines (Azure or AWS).