Lead Applied AI Engineer/Scientist
Job Description
The Lead Applied AI Engineer/Scientist at RNGD is responsible for the end-to-end technical design, development, evaluation, and ongoing improvement of applied AI systems that address construction and business challenges. The role ties measurable business targets to workflow quality across document AI, computer vision, LLMs, retrieval, tool-enabled agents, structured outputs, deterministic code, and human-review processes.
Key Responsibilities
- Partner with business and domain stakeholders to define use cases, expected outcomes, acceptance criteria, and measurable performance targets.
- Audit real-world inputs, including spreadsheets, vector and scanned PDFs, two-dimensional drawings, scales, symbol conventions, revisions, specifications, images, and three-dimensional models.
- Define the information needed at each workflow stage, identify authoritative data sources, and specify how missing, conflicting, or ambiguous information should be handled.
- Identify input-quality issues, workflow dependencies, and technical constraints that may affect model performance or business reliability.
- Design data-labeling and validation approaches with domain experts to establish reliable ground truth.
- Maintain traceability from source information through intermediate outputs, model decisions, and final business results.
- Architect end-to-end AI agents and machine-learning workflows connecting document understanding, computer vision, large language models, retrieval, tool use, business rules, and deterministic code.
- Select appropriate technical methods for each workflow stage based on accuracy, explainability, maintainability, speed, cost, and business risk.
- Define structured outputs, data contracts, tool interfaces, orchestration logic, and failure-handling requirements.
- Design human-review and approval points so domain experts can verify outputs efficiently and focus on the highest-risk decisions.
- Evaluate build-versus-buy options for models, tools, platforms, and supporting infrastructure.
- Conduct feasibility experiments before major technical or financial commitments and communicate findings to business and technical leaders.
- Develop and refine models, prompts, retrieval methods, tools, orchestration logic, and supporting data pipelines.
- Build benchmark datasets and evaluation pipelines that measure individual workflow stages and end-to-end business performance.
- Define meaningful metrics, quality thresholds, test cases, and release criteria based on business requirements.
- Perform detailed error analysis to determine where failures originate, distinguishing input, model, prompt, orchestration, tool, and process issues.
- Prioritize improvements using business impact, frequency, severity, and implementation effort.
- Maintain reproducible experiments, evaluation records, model versions, and technical documentation to support reliable decision-making.
- Run side-by-side pilots using live projects, comparing AI-generated outputs with human work and verified business outcomes.
- Analyze pilot results and communicate accuracy, limitations, risks, and improvement priorities in clear business terms.
- Partner with software and data engineers to convert prototypes into maintainable production code, APIs, workflows, and cloud-based infrastructure.
- Establish production-readiness requirements, monitoring controls, fallback procedures, and appropriate human-review mechanisms.
- Monitor production accuracy, failure patterns, user corrections, and changing data conditions, then improve future models and workflows based on results and feedback.
- Provide technical guidance and design review support for engineers, data professionals, vendors, and other contributors supporting AI initiatives.
- Make informed recommendations regarding architecture, models, platforms, vendors, and technical investments.
- Set expectations around data handling, access, traceability, human oversight, and responsible AI use.
- Maintain awareness of emerging AI capabilities and assess their relevance to RNGD’s workflows and business priorities.
- Work closely with estimators and other domain experts to understand real workflows, exceptions, review practices, and quality expectations.
- Translate business needs into technical requirements and translate technical performance into practical business implications, with clear communication to technical and non-technical stakeholders.
- Gather user feedback, identify adoption barriers, and incorporate practical workflow needs into product development, aligning technical priorities to business impact and delivery timelines.
Required Qualifications
- Bachelor’s or advanced degree in computer science, machine learning, data science, engineering, or a related field preferred; equivalent relevant experience may be considered.
- Three or more years of experience building applied AI or machine-learning systems delivered to real users, including experience providing technical direction for an AI product.
- Hands-on experience with document AI, computer vision, or complex-document processing, including layout analysis, optical character recognition, object or symbol detection, or measurement from images.
- Experience building large-language-model agents or multi-step AI workflows involving tool use, orchestration, structured outputs, retrieval, and deterministic components.
- Demonstrated experience developing benchmark datasets, evaluation pipelines, error-analysis processes, data-labeling programs, and ground-truth standards.
- Strong Python capabilities and experience collaborating on production software, APIs, data pipelines, and cloud-based AI or machine-learning infrastructure.
- Experience in construction, engineering, architecture, or manufacturing preferred, particularly involving drawings, estimating workflows, vector PDF parsing, geometric reasoning, vision-language models, or historical cost data.
- Ability to explain technical performance, limitations, and recommendations clearly to non-technical stakeholders.
Technologies
- Python
- APIs
- Document AI
- Computer vision
- Large language models
- Retrieval
- Tool use
- Orchestration
- Structured outputs
- Vector PDF parsing
- Optical character recognition
- Vision-language models
- Cloud-based AI or machine-learning infrastructure
RNGD Values Alignment
- Exemplifies RNGD’s core values: Renegade Mentality, Sweep Floors, Build Together, and Honor Promises.
Applied AI Architecture and Technical Execution
- Designs reliable end-to-end AI systems by selecting and integrating models, tools, data, deterministic components, and human-review points appropriate to the business problem.
- Challenges assumptions, tests emerging approaches, and finds practical ways to solve complex problems while demonstrating a Renegade Mentality.
Evaluation Rigor and Analytical Judgment
- Uses benchmarks, stage-level metrics, production results, and structured error analysis to determine whether systems meet defined technical and business expectations.
- Examines the details behind performance, maintains disciplined documentation, and follows failures to their actual source, reflecting the Sweep Floors mindset.
Business Impact and Product Ownership
- Connects technical decisions to measurable business outcomes and prioritizes improvements based on users, accuracy, risk, cost, and operational value.
- Communicates capabilities honestly, sets realistic expectations, and ensures released systems perform against agreed standards, aligning with Honor Promises.
Cross-Functional Partnership and Communication
- Translates effectively between domain experts, business leaders, data professionals, and software engineers to build shared understanding of requirements and results.
- Incorporates diverse expertise, communicates clearly, and designs solutions with the people responsible for using and supporting them, consistent with Build Together.
Responsible Innovation and Continuous Improvement
- Balances experimentation and speed with traceability, human oversight, production reliability, maintainability, and responsible use.
- Pursues better methods without compromising transparency, quality, or trust by combining Renegade Mentality with Honor Promises.
Location and Work Setup
Metairie, LA (onsite)