Data Engineer 4 (Cloud Operations Resilience Engineering)
Job Description
Capital One is hiring a Data Engineer 4 (Cloud Operations Resilience Engineering) to help design, build, and support cloud-first data solutions with a focus on scalability, resilience, security, and operational efficiency. This onsite role in Plano, TX works across Agile teams to deliver robust data platforms and pipelines that support high-impact experiences.
You will operate with significant independence, architecting and enforcing shared data engineering design patterns while coordinating with product managers and software engineers. The role also includes serving as an ambassador for the data engineering team, communicating technical concepts and data outcomes clearly to internal and external stakeholders.
What you’ll do
- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
- Influence developers, data analysts, and data scientists with expertise spanning machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Use Python and Spark, along with open-source relational and NoSQL databases and cloud data warehousing platforms including Databricks and Snowflake
- Design and build data pipelines and platforms with an emphasis on scalability, resilience, and operational efficiency for performance under increasing data volume and business demand
- Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
- Implement data security standards, including encryption at rest/transit and fine-grained access control, to support compliance with data privacy regulations
- Independently design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
- Partner with product managers and software engineers to deliver cloud-first data solutions intended to help drive powerful experiences for millions of Americans
- Act as a data engineering ambassador by communicating technical concepts and data outcomes clearly to promote alignment and shared understanding
- Stay current with data and technology trends, experiment with and learn new technologies, participate in internal and external communities, and mentor others in the data community
Requirements
- Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- 4+ years of experience in application development (internship experience does not apply)
- 2+ years of experience in distributed data
- 2+ years of experience with SQL
- 2+ years of experience with one programming language: Python, Java, or Scala
- 2+ years of experience in data pipeline design and development
- 1+ year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems
Technologies
- Python, Spark
- Databricks, Snowflake
- SQL
- Machine learning
- Distributed microservices
- Lakehouse architecture
- Open-source relational databases, NoSQL databases
- Encryption at rest, encryption in transit
- Fine-grained access control
Salary and benefits
Salary (Plano, TX onsite): USD 179,400 - 204,700 per year.
- Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
- Comprehensive, competitive, and inclusive set of health, financial and other benefits
Preferred qualifications
- 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
- 4+ years of hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
- 4+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
- 4+ years of experience designing, implementing, and operating real-time or streaming data pipelines
- 2+ years of experience working on data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
- 4+ years of experience with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
- 4+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
- 2+ years of experience working in an Agile development environment
- 2+ years of experience developing user-centric reusable data products
Location
- Plano, TX (onsite)
Additional employment information
- Application window: expected to accept applications for a minimum of 5 business days
- No agencies please.
- Equal opportunity: Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws
- Drug-free workplace: Capital One promotes a drug-free workplace
- Criminal history: Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with applicable laws regarding criminal background inquiries
- Immigration: Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position
- Accommodation: If you require an accommodation, contact Capital One Recruiting at 1-800-304-9102 or [email protected]
- Recruiting support: For technical support or questions about Capital One’s recruiting process, email [email protected]