Job Description
Job Description
Strong hands on PySpark Apache Spark Data Frames Spark SQL Apache SQL performance tuning
Proven data engineering background ETL ELT pipelines orchestration lake house architectures Delta Lake
Solid Python for scripting automation and APISDK integration OCI Data bricks Apache
Proficiency in SQL ANSI Spark SQL for querying transformation troubleshooting
OCI exposure Object Storage ADW Data Flow Data Catalog
Debugging mindset diagnose and resolve performance bottlenecks and service disruptions
Observability logging metrics s governance lineage cost optimization
Testing unit functional SITUAT documentation and operational runbooks
Skills
Mandatory Skills : OCI Data Lake, Strong hands on PySpark Apache Spark Data Frames Spark SQL Apache SQL performance tuning