Pyspark Developer

Title- Pyspark Developer

Job Description

Must-Have

• Minimum 6-8 years of experience in build & deployment of Bigdata applications using SparkSQL, SparkStreaming in Python;
• Minimum 5 years of extensive experience in design, build and deployment of Python-based applications;
• Design and develop ETL integration patterns using Python on Spark. Develop framework for converting existing PowerCenter mappings and to PySpark(Python and Spark) Jobs.
• Create Pyspark frame to bring data from multiple databases to Amazon S3. Expertise on graph algorithms and advanced recursion techniques. Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responses.

Good-to-Have

• Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities.