Data Engineer 4 (Python, AWS)

Build robust, cloud-first data platforms that help drive financial empowerment for millions of Americans. In this Data Engineer 4 role, you will design, develop, test, implement, and support end-to-end data solutions across Agile teams. Capital One emphasizes operational excellence, reusable engineering design patterns, and clear communication of data outcomes to stakeholders inside and outside the organization.

Location: Richmond, VA (onsite)

Compensation: USD 179,400 - 204,700 per year. Performance-based incentive compensation may also be available, including cash bonus(es) and/or long term incentives (LTI).

What you’ll do

• Collaborate with and across Agile teams to deliver technical solutions from design through implementation, testing, and ongoing support
• Influence a team of developers, data analysts, and data scientists with expertise across machine learning, distributed microservices, lakehouse architecture, and full-stack systems
• Develop using Python and Spark, leveraging open-source relational and NoSQL databases and cloud data warehousing platforms such as Databricks and Snowflake
• Independently design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
• Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
• Build data pipelines and platforms focused on scalability, resilience, and operational efficiency to maintain performance as data and business demand grow
• Implement data security standards, including encryption at rest/transit and fine-grained access control, ensuring compliance with data privacy regulations
• Serve as an ambassador for the data engineering team by explaining technical concepts and data outcomes clearly to internal and external stakeholders
• Stay current on data engineering trends by experimenting with new technologies, participating in technology communities, and mentoring members of the data community

Minimum qualifications

• Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 4 years of experience in application development (internship experience does not apply)
• At least 2 years of experience with distributed data
• At least 2 years of experience with SQL
• At least 2 years of experience with one programming language: Python, Java, or Scala
• At least 2 years of experience in data pipeline design and development
• At least 1 year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

Tools and technologies you may work with

• Python, Spark, Databricks, Snowflake, SQL, EMR, Glue, NoSQL, MongoDB, Cassandra, DynamoDB, Redshift, Airflow, Dagster, Monte Carlo, Splunk, Scala, Java

Preferred qualifications

• 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
• 4+ years of hands-on experience designing, deploying, and operating data workloads in a public cloud environment (AWS, Microsoft Azure, or Google Cloud)
• 4+ years of experience building or supporting distributed data or compute workloads using EMR, Spark, Glue, or Databricks
• 4+ years of experience designing, implementing, and operating real-time or streaming data pipelines
• 2+ years of experience with data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
• 4+ years of experience with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
• 4+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
• 2+ years of experience working in an Agile development environment
• 2+ years of experience developing user-centric reusable data products

Important: Capital One will not sponsor a new applicant for employment authorization or offer immigration-related support for this position.

Notes: This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) and promotes a drug-free workplace.

Accommodations: If you require an accommodation, contact Capital One Recruiting at 1-800-304-9102 or email [email protected].

Recruiting questions: For technical support or questions about Capital One’s recruiting process, email [email protected].