Multimodal

Multimodal Engineer Jobs

4 jobs found

1mo ago

Senior Machine Learning Engineer (CV/NLP/Multimodal/LLM/Agent)-E-Commerce Government

TikTok Seattle, WA

Seattle, WA

1mo ago Closed

$202k - $368k/yr Full time Senior Artificial Intelligence Computer Vision

This position is no longer accepting applications (closed Jul 5, 2026).

Job Description

Responsibilities

Identify and refine algorithms to spot risk, violations, and low-quality signals in e-commerce contexts such as product catalogs, shopping-cart short videos, and product-focused live streams.
Develop methods to uncover fraudulent behavior and flag risky merchants and creators.
Optimize algorithms for large-scale brand libraries, product content, and deduplication/clustering tasks.
Lead data construction, instruction fine-tuning, chain-of-thought approaches, alignment, and related work for large models in the e-commerce domain to maximize impact.
Explore reinforcement learning and operations research techniques for intelligent dispatching and audit scheduling to improve audit quality and efficiency.
Research and build multi-agent tools, models, engines, and platforms to enhance automatic planning, generalized decision-making, and multimodal interaction in e-commerce scenarios; deliver agent-based solutions and feed real-world insights back into model iterations.
Improve performance and stability of agent systems, including resource utilization, environment interaction latency, and cost efficiency; define platform roadmaps and establish a reliable agent infrastructure.
Optimize foundational algorithms across NLP, vision, multimodal, search, graph, LLM, and agent domains to support governance initiatives and apply cutting-edge tech to e-commerce use cases.
Streamline computer vision model optimization for e-commerce, covering fine-grained product image classification, object recognition, logo/brand recognition, and related feature extraction.
Advance video classification and multimodal content understanding for e-commerce short videos and live streams to enhance the shopping experience.
Enhance risk identification models for textual content in product copy, images, and voice descriptions within e-commerce contexts.
Improve risk mining algorithms for comments, reports, and public opinion content about products, short videos, and live broadcasts to bolster governance effects.
Research large-scale multimodal algorithms (vision, speech, language) and implement them in e-commerce scenarios.
Extract data from live broadcasts, products, merchants, and creators; model large-scale networks to support content understanding, multimodal representation, and community mining for problem solving.
Contribute to building a large-scale graph storage and graph learning platform enabling billions of nodes and edges for business use cases.

Requirements

Bachelor’s degree or higher in computer science or a related field.
Solid coding skills in a Linux environment, with proficiency in Python, Go, or C++.
Strong foundation in data structures and algorithms, solid ML/DL theory, and substantial practical experience.
Familiarity with 1–2 areas among NLP, computer vision, multimodal, graph algorithms, search, text/data mining, and LLM.
Excellent analytical and problem-solving abilities, with good teamwork and communication skills.
Experience in platform governance, audit, risk control, content security, or overseas internet/e-commerce operations is preferred.

Technologies

Python
Go
C++
Linux

Benefits

Medical, dental, and vision insurance
401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time

About the Team

Addressing risk and violation issues across e-commerce scenarios.
Building a secure e-commerce ecosystem and enhancing platform service capabilities.

For Los Angeles County (Unincorporated) Candidates

Interacting with internal and external clients or colleagues, with occasional unsupervised contact.
Managing confidential information and access to information technology systems with appropriate discretion.
Applying sound judgment in mission-critical situations.

TikTok Accommodation

Accommodation request details

Job Information

Base salary range in Seattle: USD 202,160 - 368,220 annually.
Compensation may vary outside this range based on qualifications, skills, experience, and location.
Benefits may vary by employment type and country of work location.
Day-one benefits include medical, dental, and vision insurance; 401(k) with company match; paid parental leave; disability coverage; life insurance; wellbeing benefits, among others.
Additional time off includes 10 holidays, 10 sick days, and 17 paid personal days per year, prorated at hire with tenure-based accruals.
The company reserves the right to modify or change benefits programs at any time, with or without notice.

View full job page →

2mo ago

Machine Learning Engineer Graduate (Short Video Content Understanding/Multimodal Recommendation) - 2026 Start (BS/MS)

TikTok San Jose, CA

San Jose, CA

2mo ago Closed

$123k - $256k/yr Full time Computer Vision Deep Learning Graduate

This position is no longer accepting applications (closed Jun 22, 2026).

Job Description

A graduate level machine learning engineer role with a 2026 start date in San Jose, CA, focused on multimodal content understanding and short-video recommendation.

Responsibilities

Lead multimodal algorithm development for TikTok’s short-video business, exploring applications of multimodal technologies in recommendations and related scenarios to improve key business metrics.
Conduct cutting-edge research in multimodal and MLLM technologies, designing robust algorithms to meet business needs while pursuing technical breakthroughs.
Drive engineering deployment and implementation, ensuring model stability, scalability, and efficiency across production environments and data pipelines.
Focus on key areas including:
- General AI platform design and development, covering few-shot/zero-shot on MLLMs, AI labeling, auto prompting, active learning, continued pretraining, and reinforcement learning.
- Integration of content understanding with recommendation systems, including UGC ecosystems, cold-start handling, interest exploration, and comment understanding.
- Leveraging multimodal techniques to build next-generation recommendation systems, such as generative models and end-to-end approaches.

Requirements

Proven experience in multimodal content understanding, with expertise in large language models (LLMs) and familiarity with current progress in the field.
Strong technical foundation in at least one major deep learning framework (e.g., PyTorch or TensorFlow).
Proactive mindset, a strong sense of ownership, excellent communication skills, and ability to collaborate across teams.
Degree attainment: Bachelor’s, Master’s, or PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline, with completion or recent graduation.
Hands-on experience deploying content understanding solutions in search, advertising, recommendation, or related domains.

Technologies

PyTorch
TensorFlow

Benefits

Medical, dental, and vision insurance from day one
401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)

LA County (Unincorporated) Candidate Notice

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment.

View full job page →

2mo ago

Senior Machine Learning Engineer, Multimodal AI, Computer Vision and Graphics - PhD Early Career

roblox San Mateo, CA

San Mateo, CA

2mo ago Closed

$196k - $242k/yr Full time Senior 3d Modeling Artificial Intelligence

This position is no longer accepting applications (closed Jun 21, 2026).

Job Description

Roblox is seeking a Senior Machine Learning Engineer at an early career PhD level to advance multimodal AI, computer vision, and graphics. The role centers on building production-ready models and safety and identity systems that underpin core platform capabilities, from world-building tools to avatar systems and personalized discovery. This onsite position in San Mateo offers a path to influence large-scale user experiences while shaping the journey from research to deployment.

Location

San Mateo, CA (onsite)

Salary

USD 195,780 - 242,100 per year

Responsibilities

Design and implement foundation models for visual and 3D creation, search, and recommendations, ensuring high fidelity, relevance, and ranking.
Decompose complex product requirements into iterative deliverables and translate applied research into scalable production systems.
Develop and deploy innovative visual and multimodal models that power core Roblox features such as world creation, avatar systems, search, and recommendations.
Build precise facial age estimation across demographics from the ground up, integrating fraud-detection techniques to create a robust and safe user identity system.

Requirements

PhD in computer science, engineering, or a related field, with a thesis aligned to Roblox’s research areas (or current pursuit of such).
Expertise in one or more of the following: computer vision, multimodal learning, 3D graphics, or large-scale representation learning.
Experience developing and training deep learning models using modern frameworks (PyTorch, TensorFlow, JAX).
Strong research track record with multiple publications and presentations in top-tier, peer-reviewed venues.
Proficiency in programming languages such as Python, C++, Go, or Java, and experience building and optimizing large-scale systems.

Technologies

PyTorch
TensorFlow
JAX
Python
C++
Go
Java

Benefits

Equity compensation

Teams hiring for this role

Content Understanding: Develop large-scale computer vision and multimodal models that classify, organize, and recommend 3D and visual content to improve user discovery, personalization, and safety.
Account Identity: Focuses on various aspects of user identity, including bot detection, alternate account detection graphs, and age estimation based on behavioral and facial features.
Safety AI Systems: Create AI that automatically inspects and filters the broad range of user-generated content on Roblox, including images, videos, audio, 3D meshes, and games. This encompasses CV models for unsafe imagery, audio analysis for screening sounds, and novel approaches for 3D content and code moderation.

View full job page →

2mo ago

CV/NLP/Multimodal LLM Machine Learning Engineer Graduate

TikTok Seattle, WA

Seattle, WA

2mo ago Closed

$148k - $301k/yr Full time Artificial Intelligence Graduate Large Language Models

This position is no longer accepting applications (closed Jun 21, 2026).

Job Description

TikTok's Trust & Safety team in Seattle is seeking a PhD-track Machine Learning Engineer with strengths in computer vision, natural language processing, and multimodal learning. This graduate program role focuses on building and deploying cutting-edge content understanding models and scalable training pipelines, with collaboration across product, engineering, and data science teams. The position starts in 2026 and is onsite in Seattle.

Responsibilities

Collaborate with product teams to define business objectives and enhance trust and safety strategy.
Work with engineering teams to deploy machine learning models, design online model workflows, and implement serving pipelines at scale.
Partner with the data science team to identify key challenges and propose data-driven strategies.
Advance state-of-the-art content understanding techniques, including unimodal and multimodal classifiers, active learning models, reinforcement learning models, and large language models.

Requirements

Candidates who are completing or have recently completed a PhD in computer science, electrical engineering, operations research, applied mathematics, or similar quantitative fields.
Hands-on or academic experience in machine learning, large language models, recommendation systems, or related areas.
Strong coding skills.
Curiosity about new technologies, an entrepreneurial mindset, and solid communication and teamwork abilities.

Technologies

Large Language Models

Benefits

Medical, dental, and vision insurance
401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
Discretionary bonuses/incentives
Restricted stock units

Compensation

Compensation Description (Annually): The base salary range for this position in the selected city is $148,200 - $300,960 annually. Compensation may vary outside this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Algorithm

CV/NLP/Multimodal LLM Machine Learning Engineer Graduate (TikTok-Trust and Safety) - 2026 Start (PhD)

View full job page →

Multimodal Engineer Jobs

Senior Machine Learning Engineer (CV/NLP/Multimodal/LLM/Agent)-E-Commerce Government

Machine Learning Engineer Graduate (Short Video Content Understanding/Multimodal Recommendation) - 2026 Start (BS/MS)

Senior Machine Learning Engineer, Multimodal AI, Computer Vision and Graphics - PhD Early Career

CV/NLP/Multimodal LLM Machine Learning Engineer Graduate

Get Multimodal Engineer Jobs alerts