Ai Model Evaluation Engineer Jobs

1 job found

Today

Cybersecurity Engineer - AI Trainer

AfterQuery Experts Columbia, SC 🇺🇸 Remote

Columbia, SC

Today

$65 - $80/hr Contract Ai Model Evaluation Ai Security Incident Response

Apply Now

Job Description

AfterQuery Experts is seeking a remote, asynchronous Cybersecurity Engineer - AI Trainer to support frontier AI labs. In this contract role from Columbia, SC (remote), you will build and evaluate security-focused training scenarios, then give clear, auditable feedback to improve the trustworthiness of model outputs.

The work centers on translating real production security practice into engineering problems that test how systems reason about threats, detections, and incident response. You will design realistic tasks, assess model answers for technical accuracy and reasoning quality, and document your judgement so another engineer can review it end to end.

Responsibilities

Design challenging, realistic security analysis, threat modeling, and incident response tasks drawn from production practice
Evaluate model responses for correctness, sound reasoning, and subtle failure modes
Document your reasoning clearly so another engineer can audit the judgement

Requirements

2+ years of professional experience in security engineering, red team, or SOC work
Familiarity with common attack classes, detection tooling, and remediation practice
Ability to explain an attack path and its mitigation clearly in writing

Compensation and Contract Details

Job type: contract
Location: Columbia, SC (remote)
Rate: USD 65 - 80 per hourly
Payment: paid weekly

Benefits

Competitive Compensation: $65-$80/hour, paid weekly
Flexible Engagement: fully remote and asynchronous, on your own schedule

AfterQuery Experts is a YC-backed research lab, and this role contributes to shaping how frontier models reason about software while maintaining rigorous security evaluation standards.

View full job page →

Get Ai Model Evaluation Engineer Jobs alerts

New Ai Model Evaluation Engineer Jobs, daily.