Data Engineer/Architect
Artificial Intelligence
Azure
Big Data
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Engineer
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Informatica
Information Technology (IT)
Programming Languages
Rag Systems
Reporting and Analytics
Software Development
SQL
Vector Databases
Job Description
Remote role in the United States designing data foundations that support AI use cases, governed access, and secure, reliable pipelines.
Responsibilities
- Evaluate data availability, quality, and readiness during discovery for candidate AI use cases
- Identify and document data risks that impact feasibility
- Design data architectures for prioritized use cases, including source-to-target flows, storage patterns, and data models for analytics and AI workloads
- Build and maintain ingestion, cleansing, transformation, and delivery pipelines from enterprise systems and authoritative data sources
- Prepare unstructured content (documents, policies, knowledge articles) for retrieval-augmented generation (RAG), including chunking, metadata, embeddings, and vector index design
- Define data access, privacy, and handling controls for sensitive data, including PII and PHI, aligned to federal and client requirements
- Implement data quality checks, lineage, and monitoring to support trustworthy, measurable pilot outcomes
- Collaborate with the AI Solutions Architect and AI product engineers to hand off documented data interfaces
- Contribute reusable data patterns to the program workflow library
Requirements
- 5+ years of demonstrated experience designing and building production data pipelines and data platforms for analytics, machine learning, or AI solutions
- Strong proficiency in SQL and Python, including data modeling for relational, dimensional, and lakehouse environments
- Working knowledge of cloud data services on Microsoft Azure or AWS, including tools such as Azure Data Factory, Databricks, Microsoft Fabric or Synapse, and AWS Glue or Amazon Redshift
- Hands-on experience preparing data for large language model applications, including document processing, embeddings, and vector stores such as Azure AI Search or Amazon OpenSearch
- Experience implementing data governance, security, and access controls for sensitive data in federal or regulated environments
- Strong written and verbal communication with technical and non-technical audiences
- Bachelor’s degree in a related field, plus 5+ years of relevant professional experience
Technologies
- SQL, Python
- Azure Data Factory, Databricks, Microsoft Fabric, Synapse
- AWS Glue, Amazon Redshift
- Azure AI Search, Amazon OpenSearch
- RAG, lakehouse
Benefits
- 401(k)
- 401(k) matching
- Flexible schedule
- Paid time off
- Retirement plan
Plusses
- Master’s degree preferred
- Experience with VA or other federal health data systems and data sharing agreements
- Relevant certifications preferred, such as Microsoft Certified Azure Data Engineer Associate, Databricks Certified Data Engineer Professional, AWS Certified Data Engineer Associate, or similar
Clearance
- Must be able to obtain and maintain a federal Public Trust background investigation and an agency-issued PIV credential
Location
- Remote (must reside in the United States)
Compensation
- USD 125,000 - 175,000 per year
Application Information
- Question: Will you now, or in the future, require sponsorship from an employer?