Lead Data Engineer
Manager
Big Data
Cloud
Cloud Data Platform
Cloud Dataflow
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering Lead
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
GCP
Google Cloud Bigquery
Google Cloud Dataflow
Google Cloud Platform
Informatica
Lead Data Engineering
SQL
Job Description
Lead Data Engineer role in COO Technology at Wells Fargo focused on cloud-native, reusable data capabilities on Google Cloud.
Responsibilities
- Design and implement scalable, secure data platforms on Google Cloud using managed services including BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, and Composer.
- Build reusable frameworks and tooling for ingestion, transformation, quality, and orchestration for adoption by multiple product and domain teams.
- Enable self-service data consumption and governance-by-design by standardizing patterns, templates, and platform capabilities instead of one-off pipelines.
- Design logical and physical data platform architectures using BigQuery, Dataflow/Apache Beam, Dataproc/Spark, Pub/Sub, and Cloud Storage.
- Define and implement standardized ingestion, transformation, and serving patterns for both batch and streaming as reusable blueprints.
- Optimize cost, performance, and reliability of GCP data workloads using partitioning, clustering, storage classes, and autoscaling strategies.
- Develop opinionated ingestion frameworks (for example, config-driven pipelines, connectors, schema handling, and error handling) built on Dataflow, Dataproc, or Composer.
- Create shared transformation libraries in Python/SQL/Beam such as common SCD patterns, data quality checks, and masking/tokenization routines.
- Provide orchestration capabilities via Cloud Composer or Cloud Workflows using reusable DAGs/templates and support CI/CD integration.
- Implement robust data modeling approaches including dimensional, data vault, or canonical models, and build semantic layers in BigQuery and related tools.
- Enforce data quality, lineage, and observability through standardized metrics, validation rules, and monitoring dashboards.
- Apply security and governance controls such as IAM, VPC-SC, CMEK, and row/column-level security with policy-driven access patterns.
- Partner with domain data engineers, analytics, and ML teams to onboard use cases onto platform services and frameworks.
- Document patterns, runbooks, and best practices; provide enablement via workshops and code examples.
- Contribute to the platform roadmap, tool selection, and evaluation of new GCP services and open-source components.
Requirements
- 5+ years of Database Engineering experience (or equivalent demonstrated through work experience, training, military experience, or education).
- 5+ years of data management experience within Public Cloud (GCP, AWS, Azure).
- 5+ years hands-on experience with Python or Java, plus Spark SQL for data pipelines, libraries, and automation tooling.
- 5+ years with orchestration tools (Cloud Composer/Airflow) and CI/CD (including Cloud Build and Git-based workflows) for data workloads.
Technologies
- Google Cloud Platform, BigQuery, Dataflow, Apache Beam, Dataproc, Spark, Pub/Sub, Cloud Storage
- Composer, Cloud Workflows
- Python, Java, Spark SQL, SQL
- Cloud Composer, Airflow, Cloud Build, Git-based workflows
- IAM, VPC-SC, CMEK
Job Expectations
- Flexible to provide both application development and production support during off-hours.
- Role is not eligible for Visa Sponsorship.
- Hybrid schedule: 3 days in office, 2 days remote.
- Work Transparently: deal in an honest, direct, and transparent way.
- Take Ownership: embrace responsibility and find joy in having the answers.
- Learn More: regularly self-educate and improve skill set.
Posting Locations
- 300 S Brevard St., CHARLOTTE, North Carolina 28202
- 401 Las Colinas Blvd W Bldg A, Irving, Texas 75039
Desired Qualifications
- Experience with logging and monitoring stacks (Cloud Logging, Cloud Monitoring, error reporting, metrics dashboards).
- Experience with automated testing, data quality checks, and monitoring for pipelines and platform services.
- Knowledge of cloud architecture principles including networking, security, IAM, reliability, and cost management.
- Experience with core GCP data services: BigQuery, Dataflow/Apache Beam, Dataproc, Pub/Sub.
- Experience with Agile transformations and technology roadmaps.
- Experience working with onshore and offshore teams.
Additional Information
- Hybrid location: Irving, TX (hybrid).
- Minimum experience: 5+ years.
- Posting end date: 19 Oct 2026 (may come down early due to volume of applicants).
- Applicants with disabilities: request medical accommodation via Disability Inclusion at Wells Fargo.
- Drug and alcohol policy: Wells Fargo maintains a drug free workplace.
- Third-party recordings are prohibited unless authorized by Wells Fargo.
- Wells Fargo requires you to directly represent your own experiences during recruiting and hiring.
Similar Jobs
J