Dataflow Engineer

Key Responsibilities

• Develop and maintain data pipelines using GoLang and Apache Beam on Google Dataflow.
• Integrate data pipelines with GCP services: BigQuery, Pub/Sub, Cloud Storage, BigTable.
• Monitor and troubleshoot pipelines using Cloud Monitoring (Stackdriver).
• Ensure cost-effectiveness, reliability, and performance of data workflows.
• Implement code quality standards and testing practices for data pipelines.
• Collaborate with cross-functional teams to deliver data-driven solutions.
• Provide mentorship and technical guidance to junior engineers.