IT-Software Engineer
Backend Developer
Agentic Ai
Ai Agent
Ai Agent Platform
Ai Platform
Ai Security
APIs
Artificial Intelligence
Artificial Intelligence Engineer
Cloud Platforms
Data Architecture
Data Integration
Database
Developer
DevOps
Engineering
Generative AI
Large Language Models
Machine Learning
Management
Project Management
Security
Software Development
Software Engineer
Software Engineering
Job Description
All IT Solutions is seeking an IT-Software Engineer for a client engagement in Chicago, IL (hybrid). This contract role emphasizes technical leadership, AI-native architecture, and secure, scalable software delivery. You will work closely with a Scrum team and help establish engineering standards through mentoring, governance, and repeatable engineering practices.
What you’ll do
- Lead architectural designs and collaborate across teams to shape end-to-end solutions that improve developer experience and workflow efficiency
- Design and orchestrate multi-agent and stateful AI workflows using modern frameworks such as LangChain, LangGraph, AutoGen, or CrewAI
- Integrate foundation models (for example, Anthropic Claude, OpenAI GPT, Google Gemini) through secure API gateways, with responsibility for token limits, cost control, and rate-limiting
- Architect AI-native data models by combining relational databases with vector databases to support semantic search and Retrieval-Augmented Generation (RAG)
- Implement white-box testing and continuous evaluation metrics to monitor AI output quality, including factual correctness, hallucination risk, and safety compliance
- Drive secure, reliable, scalable software outcomes through architectural leadership, risk management, and continuous improvement of engineering practices
- Mentor and scale the engineering team by establishing engineering standards, best practices, and architectural governance for secure coding, continuous integration, and cloud-native deployment
- Increase delivery velocity by integrating next-gen development tools (for example, Cursor, Claude Code, Windsurf) into the team’s daily SDLC
- Set governance policies and coach developers on responsible AI use, including input data sensitivity, license compliance, and security guardrails
- Evaluate existing systems, services, APIs, and data models to identify modernization, scalability, and performance opportunities
- Participate in technical leadership forums and architecture discussions with Product Owners, Technical Leads, Architects, and Engineering Managers, including PR reviews and cross-team engagement as needed
- Support platform enablement and self-service engineering capabilities, plus drive automation initiatives to improve productivity and software quality
Backend and AI platform focus
- Provide deep proficiency in backend systems, including microservices architectures and API design using Java
- Apply strong AI tool fluency, including mastery of AI coding assistants and understanding of Model Context Protocol (MCP) to mediate agent connections with external databases
Key requirements
- 8+ years of professional software engineering experience, including 2+ years in a technical leadership role
- Proven ability to mentor engineers and drive technical excellence
- Experience designing and delivering large-scale distributed systems
- Strong expertise in software architecture, APIs, microservices, cloud-native applications, and modern engineering practices
- Experience influencing multiple engineering teams and leading organization-wide technical initiatives
- Strong communication, collaboration, and stakeholder management skills
- Experience with Generative AI, AI agents, LLM-powered applications, or intelligent automation platforms
- Knowledge of security architecture, application security, and cloud security best practices
- Ability to work under pressure and within time constraints
- Experience establishing technical governance and engineering standards across multiple teams
- Cloud and DevOps: containerization (Docker, Kubernetes) and public cloud infrastructure such as AWS AI and LLM infrastructure
- Vector databases: practical knowledge of Pinecone, Milvus, Chroma, or pgvector
- Orchestration and tooling: hands-on experience with production-level AI agents, prompt engineering, and advanced agentic PDLC patterns
- Bachelor’s degree in Computer science or Electrical engineering (or related field)
- Significant interaction with the Scrum team during all Scrum ceremonies including Daily Standups, Sprint Planning, Grooming, Retro, Demo, and more
Technologies
Java, LangChain, LangGraph, AutoGen, CrewAI, Anthropic Claude, OpenAI GPT, Google Gemini, Docker, Kubernetes, AWS, Pinecone, Milvus, Chroma, pgvector, Model Context Protocol (MCP), Cursor, Claude Code, Windsurf