Data Engineer-Data Platforms-Google New
As a Data Engineer specializing in Google Cloud data platforms, you will design, build, and maintain data engineering solutions within Google's Cloud ecosystem. You will be responsible for designing and developing both batch and real-time data pipelines for Data Warehouse and Datalake environments using services such as DataProc, DataFlow, PubSub, BigQuery, and BigTable. You will build and maintain solutions leveraging Google Cloud Storage, BigTable, BigQuery, DataProc with Spark and Hadoop, and Google DataFlow with Apache Beam or Python. Managing and scheduling the data platform using Google Cloud Scheduler and Cloud Composer (Airflow) to ensure efficient pipeline operations is a key part of the role. You will also develop and implement data migration solutions ensuring seamless data transfer between systems, and design and optimize the data layer using BigQuery, BigTable, and Cloud Spanner for efficient storage and retrieval. Familiarity with open-source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala is highly valued. A Bachelor's degree is required and a Master's degree is preferred.