WIWissda Consulting Private Limited
HT- Data Engineer
Bangalore ₹3-6 LPA Posted 12 Aug 2025
FULL TIME
Spark
Etl
Data Warehousing
Sql
Python
+1 more
Job Description
- Design, develop, and maintain scalable data pipelines for batch and real-time processing
- Build robust data models and data integration workflows from multiple structured and unstructured data sources
- Work closely with Data Scientists, Analysts, and Product Managers to ensure reliable data delivery and availability
- Optimize ETL processes for data ingestion, transformation, and loading into data warehouses or data lakes
- Ensure data quality, data governance, and security compliance across the pipeline
- Write efficient and maintainable code using best practices in Python, SQL, or Scala
- Deploy and manage data pipelines using modern orchestration tools (e.g., Apache Airflow, Prefect)
- Work with cloud platforms such as AWS, Azure, or GCP to manage data storage, compute, and integration tools
- Monitor data pipeline performance, troubleshoot issues, and ensure high availability and scalability
- Collaborate in Agile/Scrum development environments and participate in code reviews