Staff Machine Learning Engineer
Job Description
Staff Machine Learning Engineer role on the Data Science Team, focused on technical leadership for large-scale AI/ML services and production ML systems.
Responsibilities
- Own the architectural vision and lead system design for core AI/ML-based services
- Serve as technical lead for complex, multi-quarter initiatives from inception through global deployment
- Design and build large-scale deep learning infrastructure and platforms for distributed model training, prioritizing low latency and high availability at enterprise scale
- Translate abstract product requirements into concrete technical designs for production systems
- Partner with Product Management, Core Engineering, and executive stakeholders to align ML capabilities with business strategy
- Mentor and guide senior and mid-level data scientists and engineers
- Set standard methodologies, define code quality expectations, and lead architecture design reviews
- Work across large-scale AI training infrastructure, including accelerators, network fabrics, CUDA, NCCL, and RDMA
- Collaborate with big data and orchestration ecosystems: Databricks, Spark, Kubernetes, Kafka, and Prometheus
- Design, develop, and support robust CI/CD pipelines for AI/ML services to ensure research work transitions smoothly to reliable production endpoints
Requirements
- PhD/Master’s degree in a technical field (computer science, mathematics, or statistics) or equivalent experience
- 7+ years of machine learning experience in industry, with a demonstrated track record operating at Lead, Principal, or Staff level
- Deep expertise designing complex machine learning systems, including ranking infrastructures and data pipelines capable of massive throughput
- Extensive production-hardened experience with frameworks such as PyTorch, JAX, or TensorFlow
- Strong production-grade programming skills in Python, Go, Java, or C++, plus strong software design principles and algorithms
- Proven ability to thrive in ambiguity, take on large unstructured problems, and drive them to technical resolution
- Strong history collaborating with, elevating, and mentoring engineering talent
Technologies
- PyTorch, JAX, TensorFlow
- Python, Go, Java, C++
- CUDA, NCCL, RDMA
- Databricks, Spark, Kubernetes, Kafka, Prometheus
Benefits
- Paid time off
- Health insurance (medical, dental, vision)
- PPO, HSA and FSA options
- 401k with employer matching contributions
- Annual bonus and/or other incentive plans
Location: New York, NY (remote)
Compensation: USD 135,100 - 231,600 per year
Similar Jobs
$2,000k - $2,000k/yr
Full time
Artificial Intelligence
Cloud Machine Learning
Distributed Machine Learning
V