Lead Data Engineer with Databricks & DBT Exp
Manager
Apache Airflow
Automation
Big Data
Bigdata
CI/CD
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Infrastructure
Cloud Platform
Cloud Platforms
Cloud Technology
Data
Data Analytics
Data Architecture
Data Build Tool
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Integration Tools
Data Lakehouse
Data Management
Data Modeling
Data Operations
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Transforms
Data Warehouse
Database
Databricks
Dbt
DevOps
Devops Tools
DevSecOps
ETL
Facilities Management
Incident Management
Informatica
Information Technology (IT)
Infrastructure As Code
Integration
Lead Data Engineering
Management
Project Management
Security Automation
Security Devops
Software Development
Spark
Workflow Orchestration
Job Description
Realign LLC is seeking a Lead Data Engineer to support enterprise-scale data engineering initiatives from an onsite base in Irvine, CA. In this role, you will lead a Data Engineering Tower/Pod focused on end-to-end data delivery, platform stability, and consistent SLA adherence, with coordination across onshore, nearshore, and offshore teams.
You will bring hands-on platform and pipeline experience to drive scalable data engineering, strengthen reliability through monitoring and production support readiness, and align technical execution with portfolio management and technology leadership stakeholders.
Key Responsibilities
- Lead and manage the Data Engineering Tower, overseeing multiple teams and delivery pods.
- Own end-to-end data platform delivery, operational excellence, and SLA adherence.
- Drive development of scalable data pipelines, focusing on data quality and platform reliability.
- Manage cross-functional dependencies, communicate with stakeholders, and escalate issues as needed.
- Ensure high availability through monitoring, alerting, and production support readiness.
- Collaborate with business, portfolio management, and technology leadership teams.
- Define and implement best practices for platform governance, operational readiness, and performance optimization.
Required Qualifications
- Strong experience with Databricks, DBT, Apache Spark, and performance tuning.
- Expertise with Apache Airflow and/or Astronomer for workflow orchestration and DAG design.
- Deep understanding of data engineering, ETL/ELT, and large-scale data platforms.
- Experience with CI/CD, DevOps, Infrastructure as Code (IaC), and automation.
- Proven platform management, monitoring, and incident management experience.
- Strong leadership and stakeholder management skills.
Technologies
- Databricks, DBT, Apache Spark
- Performance tuning
- Apache Airflow, Astronomer
- ETL/ELT
- CI/CD, DevOps, Infrastructure as Code (IaC), automation
- Monitoring, incident management
Preferred Domain Experience
- Asset Management
- Investment Management
- Capital Markets
- Portfolio & Market Data Platforms
Location: Irvine, CA (onsite)
Compensation: USD 120,000 per year
Similar Jobs
S
