EngineerJobs.io
← Back to all jobs

Job Description

Staff Machine Learning Engineer role on the Data Science Team, focused on technical leadership for large-scale AI/ML services and production ML systems.

Responsibilities

  • Own the architectural vision and lead system design for core AI/ML-based services
  • Serve as technical lead for complex, multi-quarter initiatives from inception through global deployment
  • Design and build large-scale deep learning infrastructure and platforms for distributed model training, prioritizing low latency and high availability at enterprise scale
  • Translate abstract product requirements into concrete technical designs for production systems
  • Partner with Product Management, Core Engineering, and executive stakeholders to align ML capabilities with business strategy
  • Mentor and guide senior and mid-level data scientists and engineers
  • Set standard methodologies, define code quality expectations, and lead architecture design reviews
  • Work across large-scale AI training infrastructure, including accelerators, network fabrics, CUDA, NCCL, and RDMA
  • Collaborate with big data and orchestration ecosystems: Databricks, Spark, Kubernetes, Kafka, and Prometheus
  • Design, develop, and support robust CI/CD pipelines for AI/ML services to ensure research work transitions smoothly to reliable production endpoints

Requirements

  • PhD/Master’s degree in a technical field (computer science, mathematics, or statistics) or equivalent experience
  • 7+ years of machine learning experience in industry, with a demonstrated track record operating at Lead, Principal, or Staff level
  • Deep expertise designing complex machine learning systems, including ranking infrastructures and data pipelines capable of massive throughput
  • Extensive production-hardened experience with frameworks such as PyTorch, JAX, or TensorFlow
  • Strong production-grade programming skills in Python, Go, Java, or C++, plus strong software design principles and algorithms
  • Proven ability to thrive in ambiguity, take on large unstructured problems, and drive them to technical resolution
  • Strong history collaborating with, elevating, and mentoring engineering talent

Technologies

  • PyTorch, JAX, TensorFlow
  • Python, Go, Java, C++
  • CUDA, NCCL, RDMA
  • Databricks, Spark, Kubernetes, Kafka, Prometheus

Benefits

  • Paid time off
  • Health insurance (medical, dental, vision)
  • PPO, HSA and FSA options
  • 401k with employer matching contributions
  • Annual bonus and/or other incentive plans

Location: New York, NY (remote)

Compensation: USD 135,100 - 231,600 per year

Similar Jobs