Azure ADF with PySpark Lead
This role involves leading the development of enterprise-grade ETL workflows using Azure Data Factory and PySpark on Azure Databricks. You will design scalable data pipelines, optimize Spark performance, and manage data ingestion using Azure data services. Ensuring monitoring, error handling, governance, and security is a core responsibility. The role requires close collaboration with data teams and strong troubleshooting skills.