Job Description
We are seeking a Senior MLOps engineer to collaborate closely with Data Scientists to design, build and deploy machine learning models on a modern MLOps stack.
As the Lead Machine Learning Engineer on the Recommendation Engine team, you will create and sustain pipelines for distributed model training on large compute clusters, support batch and real-time model serving, perform scalable hyperparameter tuning, and establish production validation, monitoring and governance essential for model development, testing and deployment in a controlled environment.
Our Personalization and Insights product supports high throughput, low latency applications that leverage state-of-the-art ML architectures deployed on AWS. These applications deliver personalized experiences across Chase Consumer & Community Banking channels, combining traditional banking services with offerings in Travel, Merchant Offer Shopping, and Dining spaces.
Job Responsibilities
- Build, deploy, and maintain robust pipelines for distributed training on GPU-enabled clusters to support scalable machine learning workflows.
- Develop and manage pipelines for high-throughput, real-time inference as well as batch inference, ensuring optimal performance and reliability.
- Implement quantization techniques and deploy large language models to maximize efficiency and resource utilization.
- Oversee the management and optimization of vector databases to support advanced AI and machine learning applications.
- Establish and maintain comprehensive monitoring and observability pipelines to ensure system health, performance, and rapid issue resolution.
- Collaborate with cross-functional teams to integrate new technologies and continuously improve existing infrastructure.
- Partner with product, architecture, and other engineering teams to define scalable and performant technical solutions.
Required qualifications, capabilities, and skills
- BS in Computer Science or a related Engineering field with 6+ years of experience, or MS degree in Computer Science or related Engineering field with 4+ years experience.
- Solid knowledge and extensive experience in Python and in cloud computing, preferably AWS.
- Understanding of quantization techniques such as PTQ, AWQ etc. used to quantize LLMs for accelerating inference on specific GPU architectures.
- Experience in systems engineering fundamentals: caching, CUDA, autoscaling, high throughput, low latency, x-region resilient applications.
- Deep knowledge and passion for data science fundamentals, training and deploying models.
- Experience in monitoring and observability tools to monitor model input/output and features stats.
- Operational experience in big data/ML tools such as Ray, DuckDB, Spark and in training/inference systems such as Ray, vllm/SGLang.
- Solid grounding in engineering fundamentals and analytical mindset.
Preferred qualifications, capabilities, and skills
- Experience with recommendation and personalization systems is a plus.
- CUDA experience is a big plus.
- Solid fundamentals and experience in containers (docker ecosystem), container orchestration systems [Kubernetes, ECS], DAG orchestration [Airflow, Kubeflow etc].
- Good knowledge of Databases.
About Us
JPMorgan Chase is a long-standing financial institution delivering innovative financial solutions to millions of consumers, small businesses and many prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans more than 200 years and we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
We offer a competitive total rewards package including base salary determined by the role, experience, skill set and location. Eligible employees may receive commission-based pay and/or discretionary incentive compensation, paid in cash or equity, recognizing individual achievements and contributions. A range of benefits and programs are available to eligible employees, including comprehensive health coverage, on-site wellness centers, retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Details about compensation and benefits are provided during the hiring process.
We value the diverse talents of our people and are committed to equal opportunity and inclusion. We do not discriminate on protected attributes and provide accommodations for religious practices and for mental health or disability needs. JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans.
About the Team
J.P. Morgan's Commercial & Investment Bank operates as a global leader across banking, markets, securities services and payments. Corporations, governments and institutions worldwide entrust us with their business in more than 100 countries, and the division provides strategic advice, raises capital, manages risk and delivers liquidity in markets around the world.
Location
New York, NY 10001
