Data Engineer-Data Platforms-Azure New

• Azure Synapse Analytics
• Azure Data Factory
• Azure Databricks
• Event Hub
• ADLS2
• Cosmos DB
• SQL DW
• Apache Airflow
• dbt
• Spark
• Python
• Scala
• Azure Functions
• Azure Purview
• Blob Storage
• Data Pipeline Development

As a Data Engineer focused on Azure Data Platforms, you will advise on, develop, and maintain data engineering solutions on the Azure Cloud ecosystem. You will be responsible for designing, building, and operating batch and real-time data pipelines using various Azure services.

Core responsibilities include designing and building data pipelines with Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. You will develop and operate the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB, and implement Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure Functions with Python, Azure Purview, and Cosmos DB.

You will leverage open-source technologies like Apache Airflow, dbt, and Spark with Python or Scala to build robust data engineering solutions. Ensuring seamless operations for both batch and real-time data processing is a key part of this role.

Proficiency in Azure data services, data pipeline development, data layer design, and open-source data engineering tools is required.