Software Engineering PMTS (Big Data, Spark, Hive) New
Join the Cloud Economics and Capacity Management (CECM) team as a Principal Software Engineer focused on Big Data and Infrastructure. You will build scalable, resilient distributed systems that collect, process, and analyze massive volumes of operational data to enable strategic decision-making around infrastructure expenditure and capacity management.
Your core responsibilities include driving cost optimization improvements across multiple Salesforce services, leading data pipeline and application development delivered by multiple engineers, and participating in requirement gathering, design, and development of complex datasets. You will independently design and deliver analytics tools and frameworks for diverse users including data engineers, data scientists, and domain experts.
You will mentor team members across all aspects of the data maturity lifecycle, master and improve data management processes, and build resilient automated systems while assessing and integrating best-in-class technologies. The technology stack includes Spark, Hive, Presto, Airflow, Docker, Postgres, and microservices with opportunities to work in cloud-native environments.
As part of a modern, lean, self-governing product engineering team, you will switch between coding, requirements gathering, and testing for quality and performance. You will also collaborate with data scientists to innovate and deliver analytics solutions using Big Data technologies and directly interact with internal customers to develop requirements and maintain distributed systems.