Persistent Systems is seeking an AI Engineer in New York, NY to design, build, test, deploy, and maintain secure AI applications. The work spans the full development lifecycle, with a focus on modern generative AI, retrieval augmented generation (RAG), and agent-based technologies delivered in production environments.
This role brings together software engineering and AI engineering to turn AI use cases into production-ready systems. You will collaborate with business, engineering, IT, security, and data teams, while establishing secure ingestion and retrieval pipelines, evaluating model and platform options, and supporting ongoing monitoring and governance.
Key Responsibilities
- Design, build, test, deploy, and maintain AI-powered applications
- Develop RAG systems, AI agents, and conversational AI solutions
- Partner across teams to identify AI use cases and deliver production-ready solutions
- Build secure data ingestion, retrieval, and search pipelines
- Evaluate AI models, frameworks, SDKs, and cloud services on performance, cost, security, and business fit
- Develop Python APIs and services using FastAPI, Docker, and Kubernetes
- Implement AI safety, security, governance, and monitoring practices
- Create evaluation frameworks to measure AI quality, accuracy, latency, cost, and reliability
- Integrate AI solutions with enterprise databases and analytics platforms
- Document solutions, mentor teammates, review code, and promote engineering best practices
Minimum Qualifications
- 2–5 years of experience in software engineering, machine learning, data engineering, or AI engineering
- Bachelor’s degree in computer science, engineering, data science, mathematics, or related field (or equivalent experience)
- Strong Python programming skills
- Experience building generative AI applications using LangChain, LangGraph, or similar frameworks
- Experience with RAG systems, prompt engineering, and AI application development
- Experience using at least one major AI platform: Azure AI Foundry, AWS Bedrock, Google Vertex AI, or Databricks
- Familiarity with SQL and enterprise data systems
- Strong communication and problem-solving skills
- Ability to obtain or hold a U.S. Security Clearance
Tools and Technologies
- Languages/Frameworks: Python, SQL, pandas, R
- LLM/Agent Frameworks: LangChain, LangGraph, LlamaIndex, CrewAI, AutoGen, Microsoft 365 Agents SDK, OpenAI Agents SDK, Claude Agent SDK, Google ADK
- Cloud/Platforms: Azure AI Foundry, AWS Bedrock, Google Vertex AI, Databricks
- APIs and Deployment: FastAPI, Docker, Kubernetes, CI/CD
- Model/Evaluation and Ops: Hugging Face, Ollama, LangSmith, MLflow, Braintrust, Langfuse, Arize Phoenix, MLops/LLMOps
- Analytics/BI: Power BI, Tableau
- ML Libraries: PyTorch, TensorFlow, scikit-learn, XGBoost
- Additional Products: Microsoft Copilot Studio, Power Platform, Azure Data Factory, AWS Glue
Benefits
- Medical, dental, vision, life, and disability insurance
- Paid time off (sick time and vacation time)
- Flexible spending accounts
- 401(k) plan with company match
- Fitness membership reimbursement
- Tuition assistance
- Mental health benefits
- Pet discounts
- Eligibility for a yearly discretionary bonus
Preferred Qualifications
- Experience with multiple AI frameworks, cloud platforms, or agent SDKs
- Experience deploying open-source models with Hugging Face or Ollama
- Familiarity with FastAPI, Docker, Kubernetes, MLflow, and MLOps/LLMOps
- Experience evaluating and monitoring AI systems in production
- Knowledge of Power BI, Tableau, Microsoft Copilot Studio, or Power Platform
- Data engineering experience with Azure Data Factory, AWS Glue, or Databricks
- Experience with deep learning (PyTorch or TensorFlow) and traditional machine learning (scikit-learn, XGBoost)
- Experience working in regulated or security-sensitive environments
Preferred Certifications
- Microsoft Azure AI certifications (AI-103, AI-200, AI-300)
- AWS Certified Generative AI Developer – Professional
- Google Cloud Professional Machine Learning Engineer
- Databricks Certified Generative AI Engineer Associate
Compensation: USD 133,000 - 166,000 per year. This position is onsite in New York, NY.
