The Principal Software Engineer - AI will guide the architecture and delivery of enterprise grade AI solutions within the Enterprise AI Solutions team. The role concentrates on agentic AI and retrieval augmented generation based assistants to enhance internal workflows, decision making, and overall efficiency across the company.
Major Accountabilities
- Architect Agentic Systems: define the blueprint for autonomous and semi autonomous agents that manage multi step business processes across diverse enterprise systems.
- Strategic Collaboration: work with Finance, Supply Chain, and Product leadership to identify high value automation opportunities and translate them into scalable AI solutions.
- AI Platform Development: steer the selection and deployment of models, tools, frameworks, and SDKs across Open Source and the Microsoft AI ecosystem (Microsoft Foundry and Copilot Studio), ensuring security, privacy, and cost efficiency at enterprise scale.
- System Design & Guardrails: create robust human in the loop workflows and technical guardrails to ensure AI agents operate reliably and safely in a complex corporate environment.
- Prototype to Production: supervise the end to end lifecycle of AI deployments from PoC through production level integration with internal APIs and databases.
- Technical Mentorship: serve as a subject matter expert on LLM orchestration, guiding engineers on best practices for RAG and agentic reasoning.
Requirements
- 10+ years of software development experience, with at least 4 years dedicated to AI, machine learning, and large language models.
- Hands on experience with agentic frameworks such as LangChain, LangGraph, or Semantic Kernel.
- Strong proficiency with the Microsoft AI ecosystem, including Azure OpenAI Service, Azure AI Search, and Microsoft Copilot Studio.
- Advanced Python skills focused on building scalable, highly concurrent, and maintainable enterprise backends.
- Frontend development comfort with React or comparable technologies.
- Systems integration expertise, designing RESTful APIs and integrating AI agents with ERP, CRM, and SQL or NoSQL databases.
- Architectural vision to differentiate between hype and utility, selecting the appropriate AI approach (RAG, fine tuning, or prompt engineering) for the business problem.
- Effective communication skills to explain complex AI logic and agentic workflows to non technical stakeholders using clear visuals.
- Education: degree in Computer Science, Data Science, or a closely related field.
Technologies
- LangChain, LangGraph, Semantic Kernel
- Azure OpenAI Service, Azure AI Search
- Microsoft Copilot Studio, Microsoft Foundry
- React, Python, RESTful APIs
Benefits
- Medical insurance options (three options) for regular associates
- Dental insurance
- Vision insurance
- Life insurance
- 401K
- Online learning and development courses
- Tuition reimbursement
- $100 monthly student loan support
- Mentorship programs
- $1,000 yearly lifestyle reimbursement
- 4 weeks of vacations
- 12 holidays
- Generous parental leave
- Associate discount
- Medical insurance options for temporary associates
- Dental insurance for temporary associates
- Vision insurance for temporary associates
- Associate discount for temporary associates
- 401K for part-time associates
- Short term disability
- $300 yearly lifestyle reimbursement for part-time associates
- Associate discount for part-time associates
Job Mission
New Balance seeks an experienced Principal Software Engineer to join the Enterprise AI Solutions team. The team researches and delivers AI based solutions to improve internal workflows, decision making, and operational efficiency across functions such as operations, supply chain, finance, product, and corporate services. A central focus is designing and building enterprise grade AI assistants and automations using RAG and agentic AI techniques, software agents that plan, coordinate tools, interact with systems, and execute multi step workflows with appropriate guardrails.
Preferred Qualifications
- Vector database proficiency with stores such as Azure AI Search
- Experience with persistent memory and long term state management for multi session AI agents
- DevOps for AI, including LLMOps pipelines to monitor performance, drift, and hallucinations
- Frontend prototyping familiarity with Chainlit or Streamlit for rapid internal agent interfaces
- Security-focused background with prompt injection mitigation and secure data handling in GenAI applications
Flexible Work Schedule
The North American hybrid model emphasizes in person collaboration. Associates typically work in office three days per week (Tuesday, Wednesday, Thursday) with fully open offices and available amenities to support teamwork and connectivity.
Equal Opportunity Employer
New Balance provides equal opportunity to all current and prospective associates, ensuring terms, conditions, and privileges of employment are offered without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, age, disability, or veteran status.