Data Engineer 5 (Python, SQL, Databricks, Snowflake)
Artificial Intelligence
Azure Data Engineer
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Operations
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
ETL
Informatica
Information Technology (IT)
Programming
Programming Language
Programming Languages
Snowflake
Spark
SQL
Job Description
Capital One is hiring a Data Engineer 5 for the Enterprise Platforms Technology team in Richmond, VA (onsite) to design and deliver an AI-enabling data ecosystem.
Responsibilities
- Architect, build, and scale clean, reliable, and latency-optimized batch and real-time data pipelines for AI/ML applications and Large Language Models (LLMs).
- Supply structured, semi-structured, and unstructured data to AI/ML workflows, including LLM workflows, RAG pipelines, and predictive ML models.
- Help define the architectural blueprint for the Top of House AI data layer.
- Act as a hands-on technical lead, mentoring junior and mid-level engineers on coding standards, design patterns, and engineering excellence.
- Collaborate with Enterprise Security and Data Governance to implement data classification, privacy safeguards, and automated lineage tracking for AI models and training datasets.
- Build and maintain scalable feature stores to support real-time inferencing and offline model training for executive-facing predictive models.
- Audit and optimize cross-cloud pipelines, query performance, and storage infrastructure to improve efficiency, manage cost, and increase reliability.
- Partner with Technical Program Managers, Data Scientists, Top of House leads, and C-suite stakeholders to translate executive data needs into production-ready solutions.
Requirements
- Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering).
- 6+ years of experience in application development (internship experience does not apply).
- 4+ years of experience in distributed data.
- 4+ years of experience with SQL.
- 4+ years programming with at least one: Python, Java, or Scala.
- 4+ years designing and developing data pipelines.
- 2+ years in data modeling and designing end-to-end data solutions using both relational and non-relational database systems.
Technologies
- Python, SQL, Databricks, Snowflake
- Java, Scala
- AWS, Microsoft Azure, Google Cloud
Preferred Qualifications
- Master’s Degree in a related field.
- 9+ years of application development experience including Python, SQL, Scala, or Java.
- 5+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud).
- 5+ years working on real-time data and streaming applications.
- 5+ years of data warehousing experience (e.g., Snowflake).
- Experience using interactive AI tooling to accelerate productivity, including capabilities beyond basic code completion (Claude, Gemini).
Salary
- Richmond, VA: USD 209,000 - 238,500 per year
- Performance-based incentive compensation may apply (cash bonus(es) and/or long term incentives (LTI)).
Role and Application Details
- Applications expected to be accepted for a minimum of 5 business days.
- No agencies please.
- Capital One is an Equal Opportunity Employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable laws.
- Capital One promotes a drug-free workplace.
- Capital One will consider qualified applicants with a criminal history consistent with applicable federal, state, and local requirements.
- Capital One offers comprehensive, competitive, and inclusive health, financial, and other benefits.
Accommodation and Recruiting Contact
- Accommodation requests: 1-800-304-9102 or [email protected]
- Recruiting process technical support/questions: [email protected]
Note: Position entity varies by location (Canada, United Kingdom, Philippines).