EngineerJobs.io
← Back to all jobs

Job Description

AuraOne Human Data presents a remote contract opportunity for an AI Engineer. This role centers on validating production code and AI outputs by reproducing failures, drafting the unit tests the model would generate, and providing actionable fixes to steer the modeling team. The position is remote and compensated at USD 50 - 120 per hour, welcoming engineers who excel at rigorous evaluation and clear collaboration.

Responsibilities

  • Run and reproduce candidate code outputs within a sandboxed environment to support AI Engineer assignments.
  • Assess AI engineering solutions for correctness, complexity, idiomatic style, and edge-case handling.
  • Craft minimal failing tests that reveal a bug a model output missed.
  • Compare paired solutions and provide a written rationale aligned to the evaluation rubric.
  • Label failure modes such as compile errors, runtime crashes, off-by-one issues, and security concerns with appropriate severity.
  • Document recurring code-generation failures to help the modeling team address them.
  • Calibrate reviews against gold-standard assessments to maintain high inter-rater reliability.

Requirements

  • Strong day-to-day engineering experience enabling you to read, run, and debug unfamiliar code for AI Engineer tasks.
  • Ability to write concise unit tests that capture a single failure mode.
  • Familiarity with at least one of the following frameworks: pytest, Jest, JUnit, Go test, RSpec, or equivalent.
  • Clear written reasoning capable of convincing a senior engineer.
  • Reliable asynchronous availability for at least 10 hours per week.
  • Prior code-review or technical-interview-grading experience is a plus.

Technologies

  • pytest, Jest, JUnit, Go test, RSpec
  • C#, C++, GoLang, Java, .NET, PHP, Python

Example tasks

  • Reproduce a generated engineering solution to a coding task, run the test suite, and assign a grade.
  • Write the smallest failing test that demonstrates a modelโ€™s edge-case bug.
  • Compare two paired solutions and rank them with a written rationale tied to the rubric.
  • Triage a security issue identified by a model and document the patch the model should have produced.

Nice to Have

  • Open-source contributions or a public portfolio demonstrating production-quality code.
  • Experience with the target language's standard tooling, linters, and idiomatic style guides.
  • Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns.

Skills

  • Code review
  • Debugging
  • Unit testing
  • Software engineering judgment
  • AI engineering
  • C#, C++, GoLang, Java, .NET, PHP, Python

Similar Jobs