EngineerJobs.io
← Back to all jobs

Job Description

Lead Data Engineer role in COO Technology at Wells Fargo focused on cloud-native, reusable data capabilities on Google Cloud.

Responsibilities

  • Design and implement scalable, secure data platforms on Google Cloud using managed services including BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, and Composer.
  • Build reusable frameworks and tooling for ingestion, transformation, quality, and orchestration for adoption by multiple product and domain teams.
  • Enable self-service data consumption and governance-by-design by standardizing patterns, templates, and platform capabilities instead of one-off pipelines.
  • Design logical and physical data platform architectures using BigQuery, Dataflow/Apache Beam, Dataproc/Spark, Pub/Sub, and Cloud Storage.
  • Define and implement standardized ingestion, transformation, and serving patterns for both batch and streaming as reusable blueprints.
  • Optimize cost, performance, and reliability of GCP data workloads using partitioning, clustering, storage classes, and autoscaling strategies.
  • Develop opinionated ingestion frameworks (for example, config-driven pipelines, connectors, schema handling, and error handling) built on Dataflow, Dataproc, or Composer.
  • Create shared transformation libraries in Python/SQL/Beam such as common SCD patterns, data quality checks, and masking/tokenization routines.
  • Provide orchestration capabilities via Cloud Composer or Cloud Workflows using reusable DAGs/templates and support CI/CD integration.
  • Implement robust data modeling approaches including dimensional, data vault, or canonical models, and build semantic layers in BigQuery and related tools.
  • Enforce data quality, lineage, and observability through standardized metrics, validation rules, and monitoring dashboards.
  • Apply security and governance controls such as IAM, VPC-SC, CMEK, and row/column-level security with policy-driven access patterns.
  • Partner with domain data engineers, analytics, and ML teams to onboard use cases onto platform services and frameworks.
  • Document patterns, runbooks, and best practices; provide enablement via workshops and code examples.
  • Contribute to the platform roadmap, tool selection, and evaluation of new GCP services and open-source components.

Requirements

  • 5+ years of Database Engineering experience (or equivalent demonstrated through work experience, training, military experience, or education).
  • 5+ years of data management experience within Public Cloud (GCP, AWS, Azure).
  • 5+ years hands-on experience with Python or Java, plus Spark SQL for data pipelines, libraries, and automation tooling.
  • 5+ years with orchestration tools (Cloud Composer/Airflow) and CI/CD (including Cloud Build and Git-based workflows) for data workloads.

Technologies

  • Google Cloud Platform, BigQuery, Dataflow, Apache Beam, Dataproc, Spark, Pub/Sub, Cloud Storage
  • Composer, Cloud Workflows
  • Python, Java, Spark SQL, SQL
  • Cloud Composer, Airflow, Cloud Build, Git-based workflows
  • IAM, VPC-SC, CMEK

Job Expectations

  • Flexible to provide both application development and production support during off-hours.
  • Role is not eligible for Visa Sponsorship.
  • Hybrid schedule: 3 days in office, 2 days remote.
  • Work Transparently: deal in an honest, direct, and transparent way.
  • Take Ownership: embrace responsibility and find joy in having the answers.
  • Learn More: regularly self-educate and improve skill set.

Posting Locations

  • 300 S Brevard St., CHARLOTTE, North Carolina 28202
  • 401 Las Colinas Blvd W Bldg A, Irving, Texas 75039

Desired Qualifications

  • Experience with logging and monitoring stacks (Cloud Logging, Cloud Monitoring, error reporting, metrics dashboards).
  • Experience with automated testing, data quality checks, and monitoring for pipelines and platform services.
  • Knowledge of cloud architecture principles including networking, security, IAM, reliability, and cost management.
  • Experience with core GCP data services: BigQuery, Dataflow/Apache Beam, Dataproc, Pub/Sub.
  • Experience with Agile transformations and technology roadmaps.
  • Experience working with onshore and offshore teams.

Additional Information

  • Hybrid location: Irving, TX (hybrid).
  • Minimum experience: 5+ years.
  • Posting end date: 19 Oct 2026 (may come down early due to volume of applicants).
  • Applicants with disabilities: request medical accommodation via Disability Inclusion at Wells Fargo.
  • Drug and alcohol policy: Wells Fargo maintains a drug free workplace.
  • Third-party recordings are prohibited unless authorized by Wells Fargo.
  • Wells Fargo requires you to directly represent your own experiences during recruiting and hiring.

Similar Jobs