Google Data Engineering

Key Responsibilities:

• Design, develop, and maintain scalable and reliable ETL/ELT pipelines using GCP tools.
• Build and manage data warehouses and data lakes using BigQuery and Cloud Storage.
• Integrate data from multiple sources, ensuring high data quality and integrity.
• Collaborate with data analysts, scientists, and business stakeholders to deliver data solutions.
• Optimize query performance and manage cost efficiency in data operations.
• Implement data governance, security, and privacy best practices on GCP.
• Automate workflows using Cloud Composer (Apache Airflow) and scripting.

Key Skills Required:

• BigQuery (SQL, partitioning, clustering, optimization)
• Cloud Storage, Pub/Sub, Dataflow (Apache Beam)
• Cloud Composer (Airflow)
• Cloud Functions / Cloud Run
• IAM, VPC, and GCP resource management