Team Leader - Software

Key Responsibilities

• Design, develop, and optimize data pipelines using Snowflake services.
• Work extensively with Snowflake internal and external stages for secure data loading and unloading.
• Develop and manage data ingestion processes using COPY INTO commands, file formats, and Snowpipe as applicable.
• Develop complex SQL queries, stored procedures, tasks, and streams, ensuring performance tuning.
• Ensure data quality, integrity, and security across systems.
• Collaborate with analysts, BI developers, and stakeholders to deliver data solutions.
• Use Python for data transformation, automation, and scripting tasks.
• Implement and manage CI/CD pipelines using GitLab CI/CD for automated deployment of data solutions.
• Maintain version control and manage code repositories using GitLab.
• Work with orchestration tools for scheduling and managing data workflows.
• Monitor, troubleshoot, and optimize data pipeline performance issues.