Data Engineer 4 (Manager, IC)

The Data Engineer 4 (Manager, IC) role supports Capital One’s cloud-first approach to building and delivering data solutions. Based in Chicago, IL (onsite), you will partner with Agile teams to design, develop, test, implement, and support full-stack data engineering capabilities while shaping patterns and standards across the platform.

In this position, you will lead technical execution in a hands-on capacity, influence a team of developers, data analysts, and data scientists, and help ensure scalability, resilience, and operational efficiency as data volumes and business needs grow.

Responsibilities

• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
• Influence a team of developers, data analysts, and data scientists with deep experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
• Use Python and Spark with open-source relational and NoSQL databases and cloud data warehousing platforms including Databricks and Snowflake
• Experiment with new technologies, participate in internal and external technology communities, and mentor members of the data community
• Partner with product managers and software engineers to deliver robust cloud-first data solutions that support experiences for millions of Americans pursuing financial empowerment
• Independently design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
• Architect and enforce common data engineering design patterns to support code quality, maintainability, and reusability across platforms and pipelines
• Serve as an ambassador for the data engineering team by communicating technical concepts and data outcomes clearly to internal and external stakeholders
• Design and build data pipelines and platforms with a focus on scalability, resilience, and operational efficiency
• Implement data security standards, including encryption at rest and encryption at transit, plus fine-grained access control to support data privacy compliance

Requirements

• Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• 4+ years of experience in application development (internship experience does not apply)
• 2+ years of experience in distributed data
• 2+ years of experience with SQL
• 2+ years of experience with one programming language: Python, Java, or Scala
• 2+ years of experience in data pipeline design and development
• 1+ year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

Technologies

• Python, Spark
• Databricks, Snowflake
• SQL, NoSQL databases, relational databases
• Agile
• Machine learning, distributed microservices, lakehouse architecture
• Encryption at rest, encryption at transit, fine-grained access control

Preferred Qualifications

• 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
• 4+ years hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
• 4+ years experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
• 4+ years experience designing, implementing, and operating real-time or streaming data pipelines
• 2+ years experience with data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
• 4+ years experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
• 4+ years experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
• 2+ years experience working in an Agile development environment
• 2+ years experience developing user-centric reusable data products

Salary

USD 179,400 - 204,700 per year (Chicago, IL).

Immigration Authorization

Capital One will not sponsor a new applicant for employment authorization or offer any immigration-related support for this position (including H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-3, O-1, and other forms of work authorization requiring employer immigration support).