Senior Software Engineer, AI
Job Description
Okta is seeking a Senior Software Engineer focused on Applied AI to shape GenAI-powered experiences for internal users. This remote role centers on integrating AI into scalable frontend and backend systems, delivering intuitive interfaces and robust AI-driven workflows for internal customers.
Responsibilities
- Architect and deliver end-to-end GenAI driven applications, spanning web interfaces, API services, and backend orchestration.
- Integrate large language model experiences using frameworks like LangChain and LlamaIndex, and tooling from OpenAI, Claude, or Gemini.
- Establish and promote operational excellence, including SLOs, observability, and incident response practices for deployed services.
- Build responsive, accessible frontend interfaces with React or Vue, prioritizing usability, performance, and reliability of AI outputs.
- Create and maintain a library of reusable frontend components and hooks so other teams can drop GenAI capabilities into their applications.
- Develop and maintain retrieval augmented generation pipelines with vector search and embeddings (Pinecone, FAISS, Qdrant).
- Collaborate with designers and product managers to iterate on UX patterns for AI-powered experiences, including prompt inputs, citations, and summaries.
- Ensure security, privacy, observability, and comprehensive test coverage across the full stack.
- Contribute to architecture decisions, engineering standards, and best practices for AI and automation systems.
- Partner with platform and infrastructure teams to ensure services scale reliably across the organization.
Requirements
- 5 to 8 years of software engineering with full-stack experience, including at least 2 years building AI/ML driven applications.
- More than 5 years of frontend experience with React, TypeScript, or Vue, and a track record of delivering UI/UX for internal or enterprise tools.
- Strong Python development skills and at least 2 years building cloud-based services using AWS, Docker, and RESTful APIs.
- Hands-on experience with LLM integration, RAG pipelines, prompt engineering, or orchestration frameworks such as LangChain or LlamaIndex.
- Solid background in distributed systems, APIs, microservices, container orchestration (ECS/EKS), and cloud platforms (AWS/GCP/Azure).
- Familiarity with secure coding, authentication/authorization, and internal data governance practices.
- Ability to collaborate across engineering, design, and product teams with a strong sense of user empathy and technical ownership.
Technologies
- Python
- AWS
- Docker
- RESTful APIs
- React
- Vue
- TypeScript
- LangChain
- LlamaIndex
- OpenAI
- Claude
- Gemini
- Pinecone
- FAISS
- Qdrant
- ECS
- EKS
- GCP
- Azure
Benefits
- Supporting Your Well-Being
- Driving Social Impact
- Developing Talent and Fostering Connection + Community
Why join Okta
- Make AI Real: Design and build AI powered apps used by Okta employees on a daily basis.
- Full-Stack Challenge: Address end-to-end problems from LLM coordination to polished UIs.
- Trusted Innovation: Be part of a team devoted to security, ethics, and technical excellence in AI.
The Okta Experience
- Supporting Your Well-Being
- Driving Social Impact
- Developing Talent and Fostering Connection + Community