Lead Product Software Engineer
Job Description
Grow an inventory forecasting platform that helps drive Ads Inventory Forecasting across Disney Entertainment and ESPN Product & Technology. In this onsite role in San Francisco, CA, you will lead a cross-domain team under Ad Platforms, building a unified forecasting experience and next-generation batch and real-time data infrastructure using big data and backend/full-stack practices.
You will join a team of big data and backend engineers delivering high-value projects for a high-performance, distributed, microservice-based advertising platform supporting Disney online properties, including Hulu and ESPN+. Your work will strengthen proprietary capabilities across the advertising ecosystem, from ad serving and delivery to campaign management, reporting, and the integrations needed to maintain a best-in-class video advertising business.
What you’ll do
- Contribute to a team of big data and backend engineers to deliver high value projects
- Build components of a large-scale data platform for batch and real-time processing, owning features of big data applications as business needs evolve
- Develop next-gen cloud-based big data infrastructure for batch and streaming, continuously improving performance, scalability, and availability
- Make architectural and design tradeoffs that address performance, scalability, reusability, and flexibility
- Promote best engineering practices, including design patterns, CI/CD, code review, and automated testing
- Partner with researchers to productize innovations at scale
- Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment
Team and platform context
The Forecasting Team sits within the Ad Platforms organization, supporting Ads Inventory Forecasting business requirements. The Inventory Forecasting Platform provides unified inventory forecasting modeling and result access, with an E2E scope spanning machine learning, big data, microservices, and data visualization.
Requirements
- Bachelors degree in Computer Science, Electronics Engineering, or related field
- At least 7 years of professional programming and design experience in Scala, Java, Python, etc.
- 3+ years of big data development experience with Databricks, Spark, Hive, SingleStore, Airflow, and AWS
- Strong knowledge of system and application design and architecture
- Experience processing large datasets at petabyte level
- Demonstrated cloud infrastructure experience, including Terraform, Kubernetes (K8S), Spinnaker, etc.
- Passion for technology and openness to interdisciplinary work
- Strong communication skills and project leading experience
Preferred qualifications
- Experience with cloud infrastructure technologies including Terraform, K8S, and Spinnaker
- Experience with Grafana and Datadog
- Experience with widely used web frameworks (React.js, Vue.js, Angular, etc.) and strong web stack knowledge including HTML, CSS, and Webpack
- Ads domain knowledge
Compensation: USD 173,100 - 232,100 per year
Location: San Francisco, CA (onsite)