Data Engineer

Responsibilities :-

• Analyze and organize raw data
• Build data systems and pipelines (Apache Nifi)
• Evaluate business needs and objectives
• Interpret trends and patterns
• Conduct complex data analysis and report on results
• Prepare data for prescriptive and predictive modeling
• Build algorithms and prototypes
• Combine raw information from different sources
• Explore ways to enhance data quality and reliability (Spark)
• Airflow to schedule and execute py-spark job.
• Identify opportunities for data acquisition
• Develop analytical tools and programs
• Collaborate with data scientists and architects on several projects

Requirements and skills:-

• 2-3 year of experience as a data engineer
• Technical expertise with data models, data mining, and segmentation techniques
• Knowledge of programming languages (e.g. Java and Python)
• Hands-on experience with SQL database design
• Great numerical and analytical skills
• Bachelor Degree in Computer Science, IT, or similar field; a Master s is a plus
• Data engineering certification (e.g IBM Certified Data Engineer) is a plus