EngineerJobs.io
← Back to all jobs

Job Description

Lumos AI Research builds the infrastructure that helps train and evaluate frontier AI systems in healthcare and life sciences. In this role, you will help turn human expertise and scientific knowledge into high-quality data for training and evaluating advanced AI models, shaping a core platform from early design through production.

You will also have room to move quickly and experiment: prototype fast, challenge assumptions, and improve systems without unnecessary bureaucracy. Compensation is competitive with meaningful equity, and the range for this position is $160K to $220K.

What you’ll build

This Senior Software Engineer position focuses on the data platform and infrastructure that powers creation, curation, evaluation, and delivery of high-quality data for frontier AI models. You will own systems end to end across the product and infrastructure stack, including workflows, AI-native interfaces, orchestration, evaluation and quality systems, and scaling.

Responsibilities

  • Design and implement core product features for experts to create, annotate, review, validate, and refine complex training and evaluation datasets.
  • Build flexible multi-stage pipelines that combine human contributions, AI-generated content, automated evaluation, and expert review.
  • Develop tools that enable expert collaboration with AI models, including AI-assisted annotation, content generation, feedback, and validation.
  • Create robust systems for dataset storage, versioning, lineage, transformations, quality control, and delivery.
  • Implement assignment, routing, dependencies, review queues, quality gates, and workflow automation for distributed expert teams.
  • Integrate model-based judges, programmatic verifiers, consensus mechanisms, and quality metrics to improve data reliability.
  • Build fast, intuitive interfaces for complex scientific and healthcare workflows, balancing flexibility with simplicity.
  • Develop infrastructure for model inference, structured generation, prompt execution, and automated feedback loops.
  • Improve performance, reliability, observability, and developer experience as data volume, workflow complexity, and expert participation grow.
  • Drive technical decisions from product design and system architecture through implementation, deployment, and iteration.

Requirements

  • 5+ years of software engineering experience, or equivalent evidence of exceptional engineering ability.
  • Strong proficiency in TypeScript and Python, including production-grade application development.
  • Experience with modern frontend frameworks such as React or Next.js, with a solid understanding of frontend architecture and application state management.
  • Backend experience including APIs, relational databases, asynchronous processing, and distributed services.
  • Experience designing complex data models, workflow systems, and scalable application infrastructure.
  • Strong understanding of PostgreSQL, queues, background jobs, caching, and cloud infrastructure.
  • Ability to build thoughtful user experiences for technically complex products.
  • Strong product intuition and experience turning ambiguous requirements into elegant, maintainable solutions.
  • Demonstrated ability to independently architect, ship, and iterate on complex systems.

Technologies

TypeScript, Python, React, Next.js, PostgreSQL

What you bring to the team (preferred)

  • Experience building data annotation, labeling, evaluation, or human-in-the-loop platforms.
  • Experience with AI training data pipelines, dataset curation, synthetic data generation, or model evaluation.
  • Familiarity with LLM APIs, structured generation, tool calling, prompt management, and AI-assisted workflows.
  • Experience with workflow orchestration systems, task queues, or configurable workflow engines.
  • Knowledge of data versioning, provenance, lineage, schema validation, and reproducibility.
  • Experience designing collaborative tools involving review, approvals, permissions, and complex state transitions.
  • Background in developer tools, internal platforms, scientific software, or other technically demanding products.
  • Experience working with healthcare, life sciences, or scientific datasets.
  • Preference for intellectually curious, independent builders who enjoy difficult problems, move quickly, and take pride in exceptional software.

Work setting

Location: San Francisco, CA (onsite)

What Lumos is offering

  • Develop the systems that turn human expertise and scientific knowledge into high-quality data for advanced AI models.
  • Shape architecture, user experience, and the evolution of a core platform from early design through production.
  • Work across human-AI collaboration, workflow orchestration, data systems, model integration, and quality infrastructure.
  • Collaborate with researchers, scientists, and domain experts to understand how models fail and what data they need.
  • Create tools used by physicians, scientists, and researchers to produce and validate complex data.
  • Work directly with founders and exceptional engineers in a fast-moving, intellectually demanding environment.
  • Prototype quickly and pursue better approaches without unnecessary bureaucracy.
  • Participate in the long-term value you help create.
  • Help define engineering culture, product architecture, and the future of AI data infrastructure.

About Lumos AI Research

Lumos AI Research is building the infrastructure to train and evaluate frontier AI systems in healthcare and life sciences. As AI systems become increasingly capable, progress depends not only on better models, but on the quality of the data, environments, and feedback used to train them. The team spans clinical reasoning, genomics, drug discovery, and laboratory automation, combining deep domain expertise with software infrastructure to generate training data, evaluate model behavior, and develop reinforcement learning environments for increasingly autonomous AI systems.

They are a small, ambitious team of engineers, scientists, and researchers working to expand what AI can accomplish in the real world.

Similar Jobs