Data Engineer

Job Responsibilities:

• To transition legacy Rules from Python using the Polars Library to SparkSQL
• To create new Rules using SparkSQL based on written requirements.

Must Have Skills:

• Understanding of Polars library
• Understanding of SparkSQL (this is more important than Polars)
• Good English communication
• Ability to work in a collaborative environment
• Experience with US healthcare data preferred

Understanding of SparkSQL (this is more important than Polars)