AI Engineer I

Duly Health and Care is looking for an early-career AI Engineer I to join the Data & Analytics team and collaborate closely with the AI/ML team. The work supports patient care, operations, and the colleague experience by implementing, deploying, and sustaining AI platforms and models that are designed to be reliable, secure, and cost-effective. The focus includes conversational AI and generative AI applications, including Kore.ai and Claude-based LLM solutions, plus the automation, monitoring, and operational practices that help keep them running.

What you will do

• Configure, build, and integrate conversational AI and virtual assistant solutions on the Kore.ai platform
• Support Claude-powered applications, including API integrations, prompt and system configuration, retrieval-augmented generation (RAG) pipelines, and tool or agent workflows
• Integrate AI solutions with enterprise systems, data sources, and APIs in partnership with data engineers and application teams
• Assist with testing for AI solutions, including functional testing, regression testing, and evaluation of output quality, accuracy, and safety
• Document solution designs, configurations, integrations, and release notes
• Build and maintain CI/CD pipelines and infrastructure-as-code for deploying models, prompts, and AI applications across environments
• Monitor AI performance and reliability, including availability, usage, latency, and cost, and respond to alerts and incidents
• Provide day-to-day support and troubleshooting for AI platforms and users, escalating to vendors and senior engineers as needed
• Support model and prompt versioning, evaluation, and retraining or refresh using the organization’s ML platform and MLOps practices
• Follow organizational standards for responsible AI, data privacy, security, and protection of PHI/PII, including access control and audit practices
• Partner with data scientists, data engineers, architects, application teams, and business stakeholders to define requirements and deliver dependable AI solutions
• Communicate technical concepts to non-technical audiences, including clinical and operational leaders
• Learn through code reviews and mentoring from senior engineers and data scientists
• Stay current with advances in generative AI, conversational AI, and MLOps, and share learnings with the team
• Perform all other duties as assigned

What you bring

• Bachelor’s degree in computer science, data science, information systems, engineering, or a related field, or 2 years of related experience, or an equivalent combination of education and experience
• 0-2 years of experience in software development, data engineering, DevOps, or machine learning (internships, co-ops, research, and academic projects count)
• Proficiency in Python and working knowledge of SQL
• Experience with REST APIs and JSON
• Experience with LLMs, prompt engineering, or GenAI frameworks is beneficial
• Experience with conversational AI or chatbot platforms such as Kore.ai is beneficial
• Experience with Git, CI/CD, and cloud platforms (Azure preferred), and experience with Databricks or MLflow is beneficial
• Healthcare or Epic experience is not required; training is provided
• Solid foundation in software engineering practices, including version control, testing, and code review
• Understanding of how LLMs work, including strengths and limitations
• Understanding of the machine learning lifecycle, including deployment, monitoring, and retraining
• Strong analytical, organizational, and problem-solving skills, including troubleshooting production issues
• Strong communication skills, including the ability to explain technical concepts across the organization
• Ability to work independently and in a team-oriented environment
• Intellectual curiosity and a desire to learn and adopt new AI and MLOps techniques
• Awareness of ethical AI, data privacy, and information security considerations is helpful

Skills and tools

• Python, SQL, REST APIs, JSON
• LLMs, prompt engineering, GenAI frameworks
• Kore.ai, Claude, retrieval-augmented generation (RAG)
• Git, CI/CD, cloud platforms
• Azure, Databricks, MLflow
• Infrastructure-as-code

Compensation and location

• Location: Downers Grove, IL (onsite)
• Salary: USD 65,000 - 85,000 per year

Benefits

• Comprehensive medical, dental, and vision benefits including healthcare navigation assistance
• Mental health benefit at no cost
• Employer-provided life and disability insurance
• $5,250 tuition reimbursement per year
• Immediate 401(k) match
• 40 hours paid volunteer time off
• Culture committed to community engagement and social impact
• Up to 12 weeks parental leave at 100% pay, plus a financial benefit for adoption and surrogacy for non-physician team members once eligibility requirements are met

Artificial Intelligence Disclosure: AI tools may be used in some portions of the candidate review process for this position; however, all employment decisions will be made by a person.