Data Engineer 5, Insights Platform
Apache Airflow
Automation
Azure
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
ETL
Gcp Cloud
Information Technology (IT)
Integration
Nosql Databases
Programming Languages
Snowflake
Spark
SQL
Job Description
Capital One is seeking a Data Engineer to support a major transformation by building cloud-first data solutions for insights and data platforms. This onsite role in Plano, TX focuses on designing, developing, and operating scalable data pipelines and platforms using modern data engineering, machine learning, and distributed systems.
Key Responsibilities
- Partner with Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies
- Provide technical influence within the team by applying experience across machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Use programming languages including Python and Spark, along with open-source relational and NoSQL databases, and cloud data warehousing platforms such as Databricks and Snowflake
- Stay current with data engineering trends through experimentation and learning, participation in internal and external technology communities, and mentoring
- Collaborate with product managers and software engineers to deliver robust cloud-first data solutions that support experiences for millions of Americans seeking financial empowerment
- Independently design, build, and deliver cloud data, API, and MCP solutions and applications with limited or no supervisor support
- Architect and enforce shared data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
- Build scalable, resilient, and operationally efficient data pipelines and platforms, maintaining strong performance as data volume and business demands grow
- Act as a force multiplier by balancing hands-on technical delivery, innovation, mentoring, and elevating peer and junior engineer skills
- Lead and execute large-scale, transformative data initiatives end to end, including architectural decisions and evaluating platform choices such as Snowflake vs. Databricks based on technical and business requirements
- Serve as a data engineering ambassador by communicating technical concepts and data outcomes clearly to internal and external stakeholders
Required Qualifications
- Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- 6+ years of experience in application development (internship experience does not apply)
- 4+ years of experience in distributed data
- 4+ years of experience with SQL
- 4+ years programming with at least one of: Python, Java, or Scala
- 4+ years designing and developing data pipelines
- 2+ years in data modeling and designing end-to-end data solutions using both relational and non-relational database systems
Technology Stack
Technologies used for this role include: Python, Spark, Databricks, Snowflake, SQL, NoSQL, AWS, Microsoft Azure, Google Cloud, EMR, Glue, Redshift, Airflow, Dagster, Monte Carlo, Splunk, MongoDB, Cassandra, DynamoDB, Java, Scala.
Education and Preferred Qualifications
- Master’s Degree in Computer Science or a related field
- 8+ years of experience in data engineering
- 4+ years of data modeling experience
- 9+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
- 5+ years of hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
- 5+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
- 5+ years of experience designing, implementing, and operating real-time or streaming data pipelines
- 3+ years of experience working on data observability (for example, Monte Carlo, Splunk) or data orchestration tools (for example, Airflow, Dagster)
- 5+ years of experience working with unstructured or semistructured data using NoSQL databases (for example, MongoDB, Cassandra, DynamoDB)
- 5+ years of experience designing and supporting data warehousing solutions (for example, Snowflake, Redshift)
- 3+ years of experience working in an Agile development environment
- 3+ years of experience developing user-centric reusable data products
Compensation and Benefits
Full-time annual salary range: $209,000 - $238,500 (Plano, TX).
- Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI)
- Comprehensive, competitive, and inclusive health, financial, and other benefits supporting total well-being (eligibility varies based on role)
Additional Application Notes
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position
- This role is expected to accept applications for a minimum of 5 business days
- No agencies please
- Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws
- Capital One promotes a drug-free workplace
- Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with applicable laws regarding criminal background inquiries
- If you require an accommodation, contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected]
- For technical support or questions about Capital One’s recruiting process, send an email to [email protected]