Python ETL Developer

Key Responsibilities:

• Design, develop, and maintain ETL workflows and pipelines using Python
• Extract data from various sources (databases, APIs, flat files) and perform data transformations to meet business requirements
• Load processed data into target systems such as data warehouses, data lakes, or databases
• Optimize ETL processes for performance, scalability, and reliability
• Collaborate with data architects and analysts to understand data requirements and design solutions
• Implement data validation and error-handling mechanisms to ensure data quality
• Automate routine ETL tasks and monitoring using scripting and workflow tools
• Document ETL processes, data mappings, and technical specifications
• Troubleshoot and resolve issues in ETL workflows promptly
• Follow data governance, security policies, and compliance standards

Required Skills:

• 4 to 5 years of hands-on experience in Python programming for ETL development
• Strong knowledge of ETL concepts and data integration best practices
• Experience with ETL frameworks/libraries such as Airflow, Luigi, Apache NiFi, Pandas, or similar
• Proficiency in SQL and working with relational databases (Oracle, MySQL, SQL Server, etc.)
• Familiarity with data formats like JSON, XML, CSV, Parquet
• Experience in cloud platforms and tools such as AWS Glue, Azure Data Factory, or GCP Dataflow is a plus
• Understanding of data warehousing concepts and architectures (star schema, snowflake schema)
• Experience with version control tools such as Git
• Knowledge of containerization (Docker) and CI/CD pipelines is desirable

Preferred Qualifications:

• Experience working with big data technologies such as Hadoop, Spark, or Kafka
• Familiarity with NoSQL databases (MongoDB, Cassandra)
• Experience with data visualization and reporting tools
• Certification in Python or Data Engineering tools
• Knowledge of Agile methodologies and working in collaborative teams

Soft Skills:

• Strong analytical and problem-solving skills
• Excellent communication and collaboration abilities
• Detail-oriented and committed to delivering high-quality work
• Ability to manage multiple tasks and meet deadlines
• Proactive and eager to learn new technologies and tools