Local Inference Engineer Jobs

1 job found

Today

AI Engineer

HP Palo Alto, CA

Palo Alto, CA

Today

$147k - $231k/yr Full time Artificial Intelligence Generative AI Local Inference

Apply Now

Job Description

HP is seeking an AI Engineer to design, develop, and validate a proof of concept (POC) for the Strategic Technology Accelerator. The role emphasizes rapid prototyping of applied AI capabilities, producing evaluation evidence, and delivering production-ready architectural recommendations.

Location and Salary

Location: Palo Alto, CA (onsite)
Compensation: USD 147,050 - 230,850 per year

Role Summary

In this position, you will drive the STAR POC from early ambiguity into working prototypes. You will evaluate technical approaches, document tradeoffs, and provide architectural guidance that can influence HP product roadmaps across device, cloud, and local inference experiences.

Responsibilities

Design, build, and validate applied AI proof-of-concepts for the Strategic Technology Accelerator.
Convert ambiguous product opportunities into working prototypes, evaluation evidence, architectural recommendations, and reusable technical patterns to inform product roadmaps across device, cloud, and local inference experiences.
Build AI-enabled prototypes using LLMs, agents, RAG, tool-calling, local inference, and cloud model APIs.
Evaluate architectural alternatives and document technical tradeoffs, performance, and scalability considerations.
Partner with engineering, product, and technical leadership to refine requirements and align technical direction.
Develop reusable software components and integration patterns that can transition from prototype to production.
Create technical documentation, implementation guides, and design recommendations.
Present technical findings, risks, and recommendations to stakeholders.

Required Qualifications

Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field (or equivalent experience).
Strong software engineering experience in Python, TypeScript, C++, or similar languages, with the ability to select tools that support prototype speed and production viability.
Experience building prototypes, proof-of-concept solutions, or early-stage product capabilities.
Strong software design, debugging, and problem-solving skills.
Excellent written and verbal communication skills.

Technologies

Python, TypeScript, C++
LLMs, agents, RAG
Tool-calling
Local inference
Cloud model APIs

Preferred Qualifications

Experience working on early-stage innovation or incubation projects.
Familiarity with AI-enabled applications or intelligent software systems.
Experience evaluating emerging technologies and translating prototypes into production architectures.

Core Competencies

Rapid Prototyping
Software Architecture & Design
Technical Evaluation
System Design
Software Engineering Excellence
Cross-Functional Collaboration

Benefits

Health insurance
Dental insurance
Vision insurance
Long term/short term disability insurance
Employee assistance program
Flexible spending account
Life insurance
4-12 weeks fully paid parental leave based on tenure
11 paid holidays
Additional flexible paid vacation and sick leave (US benefits overview)

View full job page →

Get Local Inference Engineer Jobs alerts

New Local Inference Engineer Jobs, daily.