Data Engineer 4 (Manager, IC)

Capital One is hiring a Data Engineer 4 (Manager, IC) to help drive a major transformation and deliver cloud-first data platforms and pipelines.

Responsibilities

• Work with and across Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies
• Influence a team of developers, data analysts, and data scientists with deep experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
• Build with Python and Spark and use open-source relational and NoSQL databases plus cloud data warehousing platforms such as Databricks and Snowflake
• Stay current with data and platform trends by experimenting, learning new technologies, and participating in internal and external technology communities
• Mentor members of the data community and share learnings through collaboration and technical discussions
• Partner with product managers and software engineers to deliver robust cloud-first data solutions that support powerful experiences for millions of Americans
• Independently design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
• Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
• Act as an ambassador for the data engineering team by clearly communicating technical concepts and data outcomes to internal and external stakeholders
• Design and build data pipelines and platforms with a focus on scalability, resilience, and operational efficiency, maintaining performance as data volume and business demands grow
• Implement data security standards including encryption at rest and encryption in transit, plus fine-grained access control to support data privacy compliance

Requirements

• Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 4 years of experience in application development (internship experience does not apply)
• At least 2 years of experience in distributed data
• At least 2 years of experience with SQL
• At least 2 years of experience with one programming language: Python, Java, or Scala
• At least 2 years of experience in data pipeline design and development
• At least 1 year of experience in data modeling and end-to-end data solution design using both relational and non-relational database systems

Technologies

• Python
• Spark
• Databricks
• Snowflake
• SQL
• NoSQL
• Open-source relational databases
• Encryption at rest/transit
• Fine-grained access control

Preferred Qualifications

• 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
• 4+ years of hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
• 4+ years of experience building or supporting distributed data or compute workloads using EMR, Spark, Glue, or Databricks
• 4+ years of experience designing, implementing, and operating real-time or streaming data pipelines
• 2+ years of experience in data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
• 4+ years of experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
• 4+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
• 2+ years of experience working in an Agile development environment
• 2+ years of experience developing user-centric reusable data products

Benefits

• Comprehensive, competitive, and inclusive set of health, financial, and other benefits to support total well-being

Location and Salary

• New York, NY (Onsite): USD 215,200 - 245,600 per year
• Also listed (Manager, Data Engineer): McLean, VA: USD 197,300 - 225,100 per year

Other Eligibility and Employment Statements

• Capital One will not sponsor a new applicant for employment authorization or offer immigration related support for this position (e.g., H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-3, O-1, or other forms requiring employer immigration support)
• Eligible to earn performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
• Expected to accept applications for a minimum of 5 business days
• No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination under applicable federal, state, and local laws
• Capital One promotes a drug-free workplace
• If you need an accommodation while applying, contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected]
• For technical support or questions about the recruiting process, email [email protected]