Staff AI Engineer
Job Description
Staff AI Engineer will act as a senior hands-on technical leader inside Nova Biomedical’s Data & AI function, helping turn enterprise AI use cases into secure, maintainable production capabilities.
Responsibilities
- Lead design, build, deployment, and support for AI agents, copilots, RAG applications, tool-calling workflows, and AI-enabled workflow automations.
- Define and implement reusable AI engineering patterns across prompt design, retrieval strategies, embeddings, vector stores, orchestration, API integration, evaluation, guardrails, logging, monitoring, and incident response.
- Build and evolve shared AI platform components including agent orchestration services, model gateway patterns, retrieval services, prompt and policy management, evaluation frameworks, secrets handling, deployment templates, and reusable integration libraries.
- Design platform controls for model access, environment separation, telemetry, cost management, usage tracking, audit logging, and responsible AI guardrails for safe reuse across teams.
- Partner with enterprise architecture, security, data engineering, analytics, IT operations, quality, and business stakeholders to ensure solutions meet enterprise requirements before scale.
- Convert prototypes into production-ready services with documented architecture, deployment steps, ownership model, monitoring approach, and support procedures.
- Establish practical evaluation harnesses to test factuality, retrieval quality, safety behaviors, workflow completion, and regression risk across releases.
- Contribute to Nova’s AI control plane and agent ecosystem by building repeatable integration patterns with enterprise systems, data platforms, business applications, and automation tools.
- Provide technical leadership to internal engineers and implementation partners via code review, design review, reusable templates, and implementation playbooks.
- Balance speed and governance by delivering business-valuable solutions while preserving security, privacy, auditability, and maintainability.
Requirements
- 10+ years hands-on experience building AI, machine learning, automation, data, or modern software applications in enterprise environments.
- Strong proficiency with Python or similar languages, plus APIs, cloud services, application integration, CI/CD concepts, and version control.
- Deep familiarity with LLMs, RAG patterns, embeddings, vector databases/vector stores, prompt engineering, agentic workflows, workflow orchestration, and model or application evaluation.
- Experience designing or operating AI platform capabilities such as model gateways, agent platforms, shared retrieval services, prompt registries, evaluation pipelines, observability stacks, or reusable deployment frameworks.
- Ability to make architecture decisions across build versus buy, prototype versus production, and centralized platform versus use-case-specific implementation.
- Experience documenting technical decisions, tradeoffs, runbooks, operating procedures, and support models for long-term maintainability.
- Strong collaboration and communication skills across business, technical, security, data, and quality stakeholders.
- Ability to mentor contributors while staying hands-on with code, integration, testing, and troubleshooting.
Technologies
- Python
- LLMs
- RAG
- Embeddings
- Vector databases, vector stores
- Agent orchestration services
- Model gateways
- API integration
- CI/CD
- Cloud services
- Azure OpenAI
- Microsoft Azure
- Power Platform
- Microsoft Fabric
- Databricks
- AWS AI services
- Microsoft 365
- Salesforce
- SAP
- ServiceNow
- MLOps, LLMOps
- Infrastructure-as-code
- Containerized services
- Identity integration
- Secrets management
- Data governance
- Identity and access management
- Privacy
- Responsible AI
Benefits
- Employment terms, work location, schedule, compensation, and benefits will align with Nova’s standard HR practices for the final approved position and posting location.
Preferred Experience
- Experience with Microsoft Azure, Azure OpenAI, Power Platform, Microsoft Fabric, Databricks, AWS AI services, or modern agent frameworks.
- Experience applying AI in regulated, GxP, medical device, diagnostics, healthcare, manufacturing, or other data-sensitive business environments.
- Experience with evaluation harnesses, prompt security, model monitoring, agent observability, prompt or policy versioning, and audit-ready AI delivery practices.
- Experience with MLOps, LLMOps, platform engineering, infrastructure-as-code, containerized services, service deployment, identity integration, secrets management, and production observability.
- Experience integrating AI applications with enterprise systems such as Microsoft 365, Salesforce, SAP, ServiceNow, document repositories, data warehouses, APIs, or workflow automation platforms.
- Familiarity with data governance, information security, identity and access management, privacy, retention, and responsible AI practices.
What Success Looks Like
- Priority AI use cases are delivered as working, documented applications or agents adopted by target users.
- AI solutions are secure, maintainable, monitored, evaluated, and ready for internal ownership after launch.
- Reusable code, templates, reference architectures, and implementation playbooks accelerate future AI delivery.
- The AI platform provides reusable services, standards, and controls that reduce one-off development and enable secure AI delivery faster for future use cases.
- Internal engineers and implementation partners follow consistent engineering patterns for AI development, deployment, evaluation, and support.
- Business stakeholders experience Data & AI as a strategic partner delivering outcomes, not only as a platform provider.
Location: Waltham, MA (hybrid) | Compensation: USD 230,000 - 280,000 per year | Experience: 10+ years