This position is no longer accepting applications
Closed on September 2, 2026.
This role is filled โ get an email when new Artificial Intelligence roles open on EngineerJobs.io:
Machine Learning Engineer Talent Network
Get alerted when similar jobs are posted — set up a New Artificial Intelligence jobs on EngineerJobs.io alert.
See other roles at AuraOne Human Data.
Job Description
Responsibilities
- Review AI outputs against current machine learning engineer specialist operations workflows, playbooks, and firm policy for Machine Learning Engineer Talent Network assignments.
- Grade tone, escalation logic, and stakeholder fit on a structured rubric.
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
- Capture the right next step so the modeling team can train on it.
- Adjudicate disputed treatments against published playbooks or firm guidance.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Requirements
- Direct working experience in machine learning engineer specialist operations on real teams for Machine Learning Engineer Talent Network work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Technologies
- Python
Benefits
- Prior experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Why this role matters
Machine Learning Engineer specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would, checking workflow, policy, and the unwritten rules that determine whether a task gets done.
Example tasks
- Grade a model's response to a real machine learning engineer specialist operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the right severity tag and corrected next step.
- Adjudicate a disputed playbook call between two reviewers using firm guidance.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Skills
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- Machine Learning Engineer specialist operations
- Python
Work model
Remote โ US-eligible. Remote ยท Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$70โ$250 / hr
Application process
Apply through AuraOne Human Data's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.