AI Engineer
Job Description
AI Engineer role focused on designing, building, and deploying intelligent AI assistants and multi-step agents on Google Cloud Platform.
Responsibilities
- Design and develop AI assistants on Vertex AI, including model selection, prompt engineering, grounding, retrieval-augmented generation (RAG), and agent orchestration
- Build multi-step AI agents using the Google Agent Development Kit (ADK), including agent architectures with tool use, sub-agents, callbacks, and session management
- Develop and integrate applications with Google Cloud AI/ML SDKs (Vertex AI SDK for Python, Google Gen AI SDK) for programmatic access to foundation models, embeddings, tuning, and prediction endpoints
- Implement agentic architectures leveraging ADK orchestration features such as sequential agents, loop agents, parallel agents, and custom agent hierarchies for multi-turn, multi-domain workflows
- Implement tool and function calling patterns in ADK agents to connect to enterprise APIs, databases, and external services for grounded, domain-specific responses
- Apply responsible AI practices: safety filters, bias detection, guardrails, hallucination mitigation, and content moderation
- Architect scalable, production-grade solutions using Vertex AI Agent Builder, Vertex AI Search, Cloud Run, Cloud Functions, Pub/Sub, BigQuery, and other GCP services
- Build evaluation and monitoring frameworks to measure assistant quality, latency, cost, and user satisfaction in production, including ADK built-in evaluation and tracing capabilities
- Partner with product managers, data engineers, and business stakeholders to translate requirements into AI-powered solutions
- Stay current with the evolving AI landscape, evaluate emerging models and tools, and recommend adoption when appropriate
Requirements
- Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field (or equivalent practical experience)
- 5+ years of software engineering experience, including at least 2+ years focused on AI/ML or LLM-based agentic development
- Hands-on experience with Google Cloud Platform, especially BigQuery, Cloud Storage, Cloud Run, or Cloud Functions
- Hands-on experience with Vertex AI Agent Builder, Vertex AI Search, or Dialogflow CX
- Hands-on experience with Google Cloud SDKs (Vertex AI SDK, Google Gen AI SDK) for model invocation, tuning, and deployment workflows
- Strong proficiency in Python and familiarity with ML/AI frameworks and libraries (e.g., LangChain, LlamaIndex, TensorFlow, PyTorch)
- Experience building agentic applications with LLMs including prompt engineering, function calling, embeddings, and RAG
- Solid understanding of API design, microservices architecture, and cloud-native development patterns
- Familiarity with Git, CI/CD pipelines, and Infrastructure as Code (e.g., Terraform, Cloud Build)
Technologies
- Google Cloud Platform (GCP)
- Vertex AI
- Vertex AI Agent Builder
- Vertex AI Search
- Google Agent Development Kit (ADK)
- Vertex AI SDK for Python
- Google Gen AI SDK
- Google Cloud AI/ML SDKs
- Google Cloud SDKs
- Cloud Run
- Cloud Functions
- Pub/Sub
- BigQuery
- Cloud Build
- Terraform
- Python
- LangChain
- LlamaIndex
- TensorFlow
- PyTorch
- Dialogflow CX
- Git
Benefits
- Paid time off
- Medical/dental/vision insurance
- 401(k)
- Suite of well-being benefits to eligible employees
Preferred Qualifications
- Google Cloud certifications (e.g., Professional Machine Learning Engineer, Professional Cloud Architect)
- Exposure to multi-agent architectures, tool-use patterns, and agentic AI frameworks
- Experience with vector databases (e.g., Vertex AI Vector Search, AlloyDB, Pinecone, Weaviate) and embedding-based retrieval
- Knowledge of MLOps practices including experiment tracking, model versioning, A/B testing, and monitoring in production
- Experience working in regulated industries (healthcare, finance, insurance) with an understanding of data privacy and compliance requirements
Minimum Education Requirements
- High school degree or equivalent required unless otherwise noted above
Location: Hingham, MA (onsite) / Boston, Hingham
Time type: Full time
Salary range: $140,310.00 - $171,490.00 per year
Education: Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field (or equivalent practical experience)