EngineerJobs.io
← Back to all jobs

Job Description

The Data & AI Engineer will provide hands-on data engineering and applied AI/LLM support for a federal proof of concept centered on AI-assisted clinical trial protocol review. The work includes preparing protocol data, configuring and testing LLM extraction workflows, and enabling traceable retrieval, comparison, and validation in approved environments.

Responsibilities

  • Implement and maintain protocol data structures and database components that support extraction, normalization, storage, retrieval, comparison, and reviewer-facing use of ICH M11-aligned and historical protocols.
  • Translate approved ICH M11, CDISC, USDM, ontology, metadata, and terminology models into practical schemas, mappings, JavaScript Object Notation (JSON) structures, and data-processing components under guidance from senior standards and architecture SMEs.
  • Develop and support ETL/ELT pipelines, Python-based data transformations, and data preparation workflows for protocol content and structured AI outputs while preserving source provenance, metadata, validation status, and reviewer feedback.
  • Support development and testing of large language model (LLM) workflows for protocol information extraction, summarization, classification, normalization, and comparison, including prompt configuration and structured-output generation.
  • Assist with retrieval-augmented generation (RAG), embeddings, semantic search, vector indexing, evidence retrieval, and context assembly to ground LLM responses in protocol content and approved reference sources.
  • Support integration of LLM and data workflows with FDA-furnished Elsa/HALO capabilities and approved data services, including PostgreSQL and/or HALO/Databricks, for evidence caching, analytics, retrieval, and dashboard-ready outputs.
  • Develop SQL and Python data-access logic and assist with APIs, JSON/XML processing, data validation, and automation for protocol extraction, historical retrieval, comparison, and source traceability.
  • Perform data- and AI-focused testing, including checks for completeness, mapping consistency, retrieval quality, unsupported or hallucinated content, ambiguity, reproducibility, prompt behavior, and regression across approved configurations.
  • Document data models, prompts, mappings, test results, interfaces, transformations, implementation decisions, and technical limitations to support client review, knowledge transfer, and iterative Proof of Concept (POC) refinement.
  • Work closely with senior data engineers, clinical protocol SMEs, data standards specialists, architects, and AI/prompt engineers to turn approved requirements into working POC components.
  • Participate in prompt and LLM testing, technical working sessions, POC demonstrations, validation activities, and iterative refinement based on client reviewer feedback.
  • Support implementation within provided platforms and approved data environments; the base effort is a proof of concept and does not require independent ownership of a production platform.
  • Escalate ambiguous clinical, semantic, or AI-generated results to designated SMEs instead of making independent scientific or regulatory interpretations.
  • Build practical data and AI engineering capability while developing deeper expertise in clinical protocols, USDM/M11 standards, semantic models, and regulated AI validation.

Requirements

  • 3-5 years of experience in data engineering, software development, data science, AI/ML, analytics, or a related technical role.
  • Hands-on experience with Python for data processing, automation, API integration, or AI/ML workflows.
  • Data modeling experience and practical working knowledge of relational databases, XML and JSON structure.
  • Practical exposure to generative AI and large language models, including prompt development, LLM APIs, structured outputs, evaluation, or application development using modern AI frameworks.
  • Ability to obtain and maintain a High-Risk Public Trust or equivalent federal client access.
  • Current ability to obtain and maintain required access without interruption in alignment with long-term program needs.
  • Authorization to work in the United States without employer sponsorship now or in the future.

Preferred Qualifications

  • Working knowledge of SQL and relational databases such as PostgreSQL, Oracle, or SQL Server; exposure to data modeling, ETL/ELT, metadata, or data-quality practices.
  • Beneficial exposure to JSON/XML, REST APIs, Git/version control, and cloud or data platforms; exposure to AWS, Databricks, or similar platforms.
  • Strong preference for familiarity with RAG, embeddings, vector search/vector databases, semantic retrieval, or grounding techniques (professional, academic, or personal projects acceptable).
  • Databricks Fundamentals or Generative AI Fundamentals or AI Agent Fundamentals certification.

Technologies

  • Python, JavaScript Object Notation (JSON), XML, SQL, ETL/ELT, PostgreSQL
  • Elsa/HALO, HALO, Databricks
  • ICH M11, Clinical Data Interchange Standards Consortium (CDISC), Unified Study Definition Model (USDM)
  • RAG, embeddings, semantic search, vector indexing
  • Large language model (LLM), APIs, REST APIs
  • Git/version control

Location and Clearance

  • Location: Hybrid, Columbia, MD
  • Clearance: Must be able to obtain a High-Risk Public Trust

Education

Bachelor’s degree in computer science, data science, computer engineering or related field.

Similar Jobs