Data Engineer-Data Platforms-Azure New
As a Data Engineer specializing in Data Platforms on Azure, you will advise on, develop, and maintain data engineering solutions within the Azure Cloud ecosystem. You will be responsible for designing, building, and operating both batch and real-time data pipelines using Azure services such as Synapse Analytics, Data Factory, DataBricks, and Event Hub. You will also design and maintain the data layer on Azure Synapse Analytics, SQL Data Warehouse, and Cosmos DB.
Your work will include implementing and maintaining Azure Data Platform components like ADLS2, Blob Storage, Azure Functions with Python, and Azure Purview. You are expected to leverage open-source technologies such as Apache Airflow, dbt, Spark with Python or Scala to build robust data engineering solutions. Ensuring seamless operations for both batch and real-time data processing pipelines is a key part of this role.
This position is based within IBM Consulting's Client Innovation Center and involves working with a wide range of public and private sector clients, delivering deep technical expertise to drive innovation and technology adoption. A Bachelor's degree is required, and a Master's degree is preferred.