kpo statistical tools sas

Job Description

AWS Data Engineer 

Key words - Sas, Sas bi, Sas di. Sas MA  

Experience - 5 to 8 years  

Location - Hyderabad and Chennai 

Responsibilities: 

• Participate in efforts to design, build, and develop rapid solutions and services 
• Implement ETL/ELT Processes: Develop Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, Open Source and AWS tools. 
• Build applications using Python, SQL and AWS 
• Be a key team member in design and development of the Data pipeline. 
• Apply knowledge of basic principles, methods and practices to simple and moderately complex assignments 
• Proactively identify and implement opportunities to automate tasks and develop reusable frameworks 
• Implement standardized, automated operational and quality control processes to deliver accurate and timely data and reporting to meet or exceed SLAs 
• Collaborate with the other engineering team members to ensure all services are reliable, maintainable, and well-integrated into existing platforms 
• Review functional and technical designs to identify areas of risk and/or missing requirements 
• Provide technical write-ups and drawings to promote the proposed solutions. 
• Requirements: 
• 6-7 years' experience with automation of DevOps build 
• Experience working directly with technical and business teams 
• Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon Athena, Amazon Redshift, Amazon Cloud watch, Amazon SNS and AWS Step Functions. 
• Strong experience with modern programming languages such as Python, Spark, and Scala. 
• Create Email alerts to send any notification mail. 
• Create new airflow DAG's and workflows for each source systems. 
• Define Trigger events either time or file based on the requirements 
• Familiar with AWS Services like EC2, S3, Redshift/Spectrum, Glue, Athena, RDS, Lambda, and API gateway; 
• Familiar with software DevOps CI/CD tools, such Git, Jenkins, Linux, and Shell Script 
• Ability to learn quickly, be organized and detail oriented 
• Build of DAG's and Airflow 
• Experience in Software Engineering and Development 
• Understanding of database schema design