Llm

Llm Engineer Jobs

5 jobs found

7d ago

AI Engineer

CTC Group Fort Meade, MD

Fort Meade, MD

7d ago

$190k - $220k/yr Full time Agentic Ai Ai Agent Ai Engineer

Apply Now

Job Description

CTC Group is hiring an AI Engineer to support technical advisory and systems engineering efforts for AI-enabled applications in Department of Defense (DoD) environments.

Responsibilities

Provide technical advisory support to government teams building, integrating, and evaluating AI/ML-enabled applications and tools.
Assess AI architectures using LLMs, retrieval-augmented generation (RAG), agentic workflows, prompt engineering, and orchestration frameworks.
Evaluate emerging AI frameworks, libraries, and development tools to determine fit for mission requirements and operational environments.
Review AI application designs, model integration approaches, data pipelines, and technical risks across performance, reliability, security, and scalability.
Produce prototypes, technical recommendations, engineering documentation, and briefings to support AI adoption and decision-making.
Support testing and evaluation of AI systems, including model performance, workflow validation, guardrails, and evaluation frameworks.
Partner with software engineers, platform teams, product managers, and government stakeholders to integrate AI capabilities into existing systems and workflows.
Research emerging AI technologies, development methodologies, and best practices to identify innovation and continuous improvement opportunities.

Requirements

Active TS/SCI with CI polygraph (polygraph must be current and completed within the past 7 years).
Master's degree (or degree in Computer Science, Engineering, Data Science, Mathematics, or a related discipline; substitutions may apply based on applicable education/experience).
Experience designing, developing, integrating, or evaluating AI/ML-enabled applications and software tools.
Experience with LLM applications, RAG, prompt engineering, and agentic AI workflows.
Familiarity with AI orchestration frameworks, including: LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, Haystack, or LlamaIndex.
Experience with software development, APIs, data integration, and system architecture.
Preferred: Python, JavaScript/TypeScript, vector databases, embeddings, model APIs, and AI evaluation frameworks.
Preferred: experience with secure AI development, cloud-based AI environments, or DoD/Intelligence Community applications.

Technologies

LLMs
Retrieval-augmented generation (RAG)
Prompt engineering
LangChain, LangGraph
Semantic Kernel, AutoGen
CrewAI, Haystack, LlamaIndex
Python
JavaScript/TypeScript
Vector databases
Embeddings
Model APIs
AI evaluation frameworks

Compensation

Estimated salary range: USD 190,000 - 220,000 per year

Location

Fort Meade, MD (onsite)

Benefits

Health/Dental/Vision
401k
PTO and holiday pay
Disability and life insurance
Opportunities for continuous education and development

Education and Experience Requirements

HS Diploma/GED or Associate's degree with 20 years of relevant experience, or
Bachelor's degree and 18 years of relevant experience, or
Master's degree and 15 years of relevant experience

View full job page →

14d ago

Senior AI Engineer

Johnson Service Group Inc. New York, NY

New York, NY

14d ago

$65 - $80/hr Contract Agentic Ai AI Ai Agent

Apply Now

Job Description

Contract role for an Agentic AI and Machine Learning Engineer to build secure, reliable agentic AI systems for production diagnostics, automation, and remediation.

Responsibilities

Design and implement tool-calling agents combining retrieval, structured reasoning, and secure action execution using Model Context Protocol (MCP).
Develop function calling flows, change orchestration, policy enforcement, and least-privilege access controls for agent actions.
Create evaluation frameworks for open-source and foundation LLMs, including prompt synthesis, response validation, and self-correction loops.
Integrate agents with observability, incident management, and deployment systems to support automated diagnostics, runbook execution, remediation, and post-incident summaries with full traceability.
Work with production engineers and application teams to define agentic AI roadmaps and measurable objectives tied to reliability, risk reduction, and cost.
Implement validator models, adversarial prompt handling, policy checks, deterministic fallbacks, circuit breakers, and rollback strategies.
Build RAG pipelines, curate domain knowledge, validate data quality, and set feedback loops and milestones to keep knowledge fresh.

Requirements

5+ years of software development experience in one or more languages, including Python, C/C++, Go, or Java.
3+ years designing, architecting, testing, and launching production ML systems, including model deployment and serving, evaluation, monitoring, data processing pipelines, and fine-tuning workflows.
Practical LLM experience with API integration, prompt engineering, fine-tuning or adaptation, and applications using retrieval-augmented generation (RAG) and tool-using agents.
Experience with vector retrieval, function calling, and secure tool execution.
Knowledge of commercial and open-source LLMs, including OpenAI, Gemini, Llama, Qwen, and Claude.
Solid understanding of applied statistics, core ML concepts and algorithms, and data structures.
Strong analytical problem-solving skills with ownership and urgency, focused on measurable business impact.
Ability to communicate complex ideas clearly and collaborate effectively across global teams.

Technologies

Python, C/C++, Go, Java
Machine learning (ML) systems
LLMs, API integration, prompt engineering, fine-tuning
Retrieval-augmented generation (RAG), tool-using agents
Vector retrieval, function calling
OpenAI, Gemini, Llama, Qwen, Claude
Model Context Protocol (MCP)

Nice to Have

Strong hands-on experience building and maintaining large-scale Python applications.
Proficiency building and operating cloud infrastructure, ideally AWS.
Experience with containerized services using ECS/EKS, serverless computing using Lambda, and data services including S3, DynamoDB, and Redshift.
Experience with Step Functions, SageMaker, and Infrastructure as Code using Terraform or CloudFormation.

Location, Job Type, and Pay

Location: New York, NY (hybrid)
Job type: Contract
Rate: USD $65 - $80 per hour (dependent on experience)
Minimum experience: 3 years

View full job page →

1mo ago

Senior AI Engineer

Simpson Thacher & Bartlett New York, NY

New York, NY

1mo ago Closed

$175k - $200k/yr Full time Senior Agentic Ai AI

This position is no longer accepting applications (closed Oct 29, 2026).

Job Description

Simpson Thacher & Bartlett is hiring a Senior AI Engineer for the Infrastructure Automation & Orchestration team to design, build, and operationalize enterprise-scale Generative AI systems.

Responsibilities

Design, develop, and deploy enterprise Generative AI solutions using commercial and open-source foundation models
Build and maintain AI agents, agent orchestration frameworks, and multi-agent systems to automate complex business processes
Develop and implement Retrieval-Augmented Generation (RAG) architectures using enterprise knowledge repositories and structured and unstructured data sources
Create custom AI tools, hooks, skills, and integrations to extend agent capabilities and improve business outcomes
Build and maintain Model Context Protocol (MCP) servers and supporting infrastructure to securely integrate AI systems with enterprise applications and services
Develop AI-powered applications using Python, APIs, and cloud-native services
Monitor, optimize, and scale data workflows to improve performance and cost-efficiency
Establish best practices for data engineering processes, documentation, and governance
Partner with infrastructure and security teams to deliver scalable, secure, and compliant AI solutions
Collaborate with stakeholders to identify, prioritize, and deliver high-impact AI use cases
Provide technical guidance on AI architecture, implementation patterns, and emerging industry capabilities

Requirements

5–8 years of experience in software engineering, cloud engineering, or AI engineering
2+ years designing and deploying Generative AI or LLM-based solutions in enterprise environments
Strong experience with Python and modern software development practices
Experience building AI agents/frameworks and AI-powered automation solutions
Experience developing custom AI tools, skills, functions, and integrations
Experience integrating AI solutions with enterprise APIs, databases, and SaaS platforms
Strong understanding of prompt engineering, context management, model evaluation, and AI application architecture
Knowledge of vector databases, semantic search, and document retrieval techniques
Strong understanding of AI security, governance, and data privacy practices
Exceptional analytical, troubleshooting, and problem-solving abilities
Excellent communication skills and experience working with technical and non-technical stakeholders

Technologies

Python
LLMs
Retrieval-Augmented Generation (RAG)
Vector databases
Semantic search
Document retrieval techniques
Model Context Protocol (MCP)
Claude Code
Anthropic APIs
MCP servers
Agentic development frameworks
Azure AI Foundry
Azure OpenAI Service
Azure AI Search
Cloud-native services
APIs
Enterprise APIs
Databases
SaaS platforms

Preferred

Experience with Claude Code, Anthropic APIs, MCP servers, and agentic development frameworks
Experience with Azure AI Foundry, Azure OpenAI Service, Azure AI Search, and related Azure AI services

Location

New York, NY (hybrid)

Compensation

USD 175,000 - 200,000 per year (estimated base salary range at time of posting)
Exempt role (not overtime pay eligible)
Simpson Thacher will not sponsor applicants for work visas for this position

Education

Bachelor’s degree in Computer Science, Information Systems, or a related field, or equivalent practical experience

Privacy Notice: For information about how Simpson Thacher & Bartlett LLP collects and processes your personal information, please refer to our Privacy Notice available at https://www.stblaw.com/other/privacy-notice.

View full job page →

2mo ago

Staff Machine Learning Engineer

Estee Lauder New York, NY

New York, NY

2mo ago Closed

$119k - $197k/yr Full time Backend Developer Agentic Ai AI

This position is no longer accepting applications (closed Sep 28, 2026).

Job Description

The Staff Machine Learning Engineer (player-coach) will design, build, test, and deploy production AI products and the underlying platform that enables agentic, LLM-powered capabilities on Google Cloud. The role combines applied machine learning with software engineering rigor, including support for stateful and transactional systems, and includes mentoring responsibilities.

Key Responsibilities

Design, build, test, and deploy production agentic and LLM-powered products end-to-end on Google Cloud, including the shared platform, tooling, and harnesses beneath them.
Apply strong software-engineering rigor to services that involve stateful and transactional (OLTP) systems, with focus on data modeling, concurrency, idempotency, reliability, observability, and testing.
Use classical ML, statistics, and experimentation when appropriate, including predictive modeling, statistical inference, hypothesis testing, and causal or incrementality measurement.
Build scalable automation tools for domains such as recommendation and personalization, conversational and customer experiences, and measurement and incrementality.
Produce design documents, maintain standards for clean code and documentation, and review designs and deliverables.
Mentor and develop engineers and scientists, including participation in early-career and student mentorship efforts.
Collaborate with engineering, product, and domain-expert teams on cross-functional automation, measurement, and modeling initiatives.
Participate in ELC’s diversity and inclusion agenda.

Required Qualifications

BS/BA in a quantitative or technical field (for example, Computer Science, Statistics, Mathematics, Physics, Engineering, Operations Research, Economics) or equivalent practical experience; a graduate degree is a plus.
5+ years of experience (or 3+ years with a graduate degree) across Software Engineering, Machine Learning, and/or Data Science.
Strong general software engineering in Python, including clean API and service design, data-structures and algorithms, and a disciplined approach to testing. Experience building and operating production-grade services, including stateful/transactional systems and databases using SQL and/or NoSQL.
Production experience deploying and operating LLM-powered or agentic systems (examples: retrieval-augmented generation, agents and tool use, structured outputs, evaluation, safety) or a strong production ML background with a clear interest in transitioning into this space.
Experience deploying and operating systems on a major cloud platform, with Google Cloud as a plus, and sound data-processing practices at scale.
Experience using agentic/AI-assisted development tools, or a strong willingness to adopt them with judgment to protect quality.
A track record of mentorship, continuous learning mindset, bias for simplicity, and collaborative shared-ownership working style.

Technologies

Python
Google Cloud
SQL, NoSQL
Retrieval-augmented generation
LLM-powered systems
Agentic systems
Vertex AI
Cloud Run
BigQuery
Firestore
Pub/Sub
FastAPI
Container-based CI/CD
Model Context Protocol (MCP)

Benefits

Health insurance coverage (medical, dental, and vision insurance)
Wellness and family support programs
Life and disability insurance
Retirement savings plans
Paid leave programs
Education-related programs
Paid holidays and vacation time
Bonus program (highly competitive), with the possibility for overachievement
Participation in the share incentive plan

Preferred / Strong Plus

Depth in classical ML, data science, and statistics, including statistical modeling, hypothesis testing and experimentation, causal inference and incrementality, and predictive modeling.
Hands-on experience in NLP, agent frameworks, or advanced statistical methods.
Familiarity with the stack, including Google Cloud (Vertex AI, Cloud Run, BigQuery, Firestore, Pub/Sub), async Python (FastAPI), container-based CI/CD, and the Model Context Protocol (MCP).
Experience designing a technical roadmap and leading execution in a business environment.

Compensation and Pay Range

The anticipated base salary range is $119,300.00 to $196,600.00 per year.
Exact compensation depends on factors such as experience, skills, education, and budget.
Salary range may vary based on geographic location.
In addition to base salary, the position is eligible for participation in a highly competitive bonus program and the share incentive plan.

Location

New York, NY (onsite)

View full job page →

2mo ago

AI Engineer

SCIGON Chicago, IL

Chicago, IL

2mo ago Closed

$52 - $70/hr Full time AI Artificial Intelligence Azure Ai

This position is no longer accepting applications (closed Sep 28, 2026).

Job Description

SCIGON is seeking an Applied AI Engineer to design, deploy, and operationalize enterprise AI capabilities. The position centers on implementing LLM-powered solutions with governance, security, and integration into existing systems, with an emphasis on production readiness and ongoing support.

Role Responsibilities

Design, deploy, and manage reusable AI capabilities within enterprise AI platforms, including skills, tools, and plug-in functionality.
Own the full lifecycle of AI enablement solutions, from intake and configuration through deployment, governance, ongoing support, and optimization.
Configure foundation models such as Claude, Gemini, and comparable technologies to enable enterprise automation and business workflows.
Deliver AI solutions from concept through production implementation, ensuring scalability, security, and operational readiness.
Integrate existing enterprise systems, services, and approved tools using available connectivity frameworks and protocols.
Collaborate with Security, Cloud, and Infrastructure teams to implement access controls, identity management practices, and credential governance.
Ensure compliance with AI governance standards, including auditability, monitoring, risk controls, and operational guardrails.
Partner with engineering, automation, data, and business teams to identify opportunities and deliver AI-driven capabilities.

Required Qualifications

Proven experience developing, publishing, and managing Claude Skills or plug-ins in a production environment.
Demonstrated success deploying AI capabilities that are actively used by business stakeholders.
Ability to contribute quickly with minimal onboarding and ramp-up time.
Experience building and deploying solutions in regulated or highly governed enterprise environments.
Strong understanding of security controls, compliance requirements, access management, and operational governance.
Comfort working within structured delivery processes and change-control frameworks.
Strong communication and stakeholder management skills.
Capability to translate business challenges into practical AI-enabled solutions.
Experience collaborating with technical and non-technical audiences.
5+ years of experience in software engineering, automation engineering, or a related technical discipline.
At least 2 years designing and deploying production-grade solutions powered by large language models.
Strong proficiency in Python development and API-based integrations.
Experience with enterprise software integration patterns and distributed systems.
Solid engineering practices, including testing, source control, observability, monitoring, and supportability.
Hands-on experience with modern LLM ecosystems, including prompt engineering, model configuration, tool integration, and function execution.
Experience working in public cloud environments such as Azure, Google Cloud Platform, Vertex AI, or equivalent technologies.
Ability to evaluate AI use cases pragmatically, including determining when traditional engineering approaches may be more effective.
Self-directed ability to independently lead technical initiatives in a fast-moving environment.

Technologies

Claude, Gemini
Python
Azure
Google Cloud Platform
Vertex AI
LLM ecosystems
Model Context Protocol (MCP)
RAG architectures
Vector databases, embeddings
Semantic search solutions
RBAC

Preferred Qualifications

Experience building AI agents and multi-agent workflows.
Familiarity with orchestration platforms and agent frameworks.
Understanding of Model Context Protocol (MCP) implementations and agent-to-agent integrations.
Experience with RAG architectures, vector databases, embeddings, and semantic search solutions.
Knowledge of modern identity and access management concepts, including RBAC, service accounts, agent identities, and least-privilege models.
Prior experience supporting organizations operating in highly regulated industries such as insurance, financial services, healthcare, or similar sectors.

Location and Compensation

Location: Chicago, IL (onsite)

Compensation: USD 52 - 70 per hour

Minimum Experience: 5 years

View full job page →

Llm Engineer Jobs

AI Engineer

Senior AI Engineer

Senior AI Engineer

Staff Machine Learning Engineer

AI Engineer

Get Llm Engineer Jobs alerts