Principal GenAI Data Engineer
Agentic Ai
Ai Agent
Ai Agent Platform
Ai Platform
Ai Security
Artificial Intelligence
Artificial Intelligence Engineer
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Databricks Mlflow
ETL
Genai
Generative AI
Graph Databases
Informatica
MLOps
Rag Architectures
Software Development
Software Engineering
Vector Databases
Job Description
Build and scale enterprise-ready GenAI data platforms with Zscaler in a hybrid role based in San Jose, CA (3 days in office). Reporting to the Senior Manager, Enterprise AI Data Platform, you will help define architectures and pipelines that power production-grade Generative AI applications, from data ingestion through knowledge preparation and serving.
What you’ll focus on
- Architect enterprise-scale GenAI data platforms for ingestion, transformation, enrichment, and serving of both structured and unstructured data
- Design scalable knowledge ingestion pipelines from diverse sources, including documents, SaaS platforms, knowledge bases, collaboration tools, and databases
- Define workflows for metadata extraction, chunking, enrichment, embeddings generation, and overall knowledge preparation
- Design AI-ready data models and storage strategies for vector, graph, and hybrid knowledge systems
- Architect unstructured data processing pipelines spanning text, images, PDFs, tables, and multimodal content
Core requirements
- Foundational understanding of AI/ML technologies, with experience leveraging, securing, or positioning AI-driven solutions to optimize outcomes in your functional domain
- Expert-level Python programming and software engineering capabilities
- Experience building distributed and scalable data pipelines for AI workloads
- Strong understanding of unstructured data extraction and processing pipelines
- Experience with vector databases, graph databases, and metadata/knowledge storage systems
- Hands-on experience with clustering, entity recognition algorithms, and modern retrieval strategies, including RAG, search, and agentic AI workflows
Tools and technologies
- Python, RAG, vector databases, graph databases
- LangSmith, Arize Phoenix, Weights & Biases, MLflow
- LangGraph, CrewAI, Google ADK
Benefits
- Various health plans
- Time off plans for vacation and sick time
- Parental leave options
- Retirement options
- Education reimbursement
- In-office perks, and more
Role details
Location: San Jose, CA (hybrid). This role reports to the Senior Manager, Enterprise AI Data Platform in the Information Technology Data Strategy department.
Compensation: USD 185,500 - 265,000 per year.
Additional accommodations and transparency
- Zscaler complies with all applicable federal, state, and local pay transparency rules.
- Zscaler provides reasonable support during recruiting processes for candidates who are differently abled, have long term conditions, mental health conditions, or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support.