Principal Data Engineer, People Data
Apache Airflow
Big Data
Bigdata
Cloud Data Warehouse
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Build Tool
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Lake
Data Lakehouse
Data Management
Data Modeling
Data Operations
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
ETL
Snowflake
SQL
Job Description
Okta is hiring a Principal Data Engineer on the Data and Insights team to architect and maintain scalable data solutions for People (HR) data across the employee lifecycle.
Responsibilities
- Design, build, and continuously improve high-scale data solutions that act as organizational reference architecture and make data access simpler across teams
- Create data quality frameworks including monitoring, anomaly detection, and alerting, with governance, lineage tracking, and rigorous change management for externally reported metrics
- Set and drive adoption of consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards
- Lead cross-functional technical initiatives across data verticals to accelerate delivery and strengthen reliability of data systems
- Make sound technical decisions in ambiguous environments, balancing near-term delivery with long-term infrastructure investments
- Champion Data Contracts by implementing data contract practices and schema evolution approaches to support reliability across global product teams
- Mentor and scale the organization by raising the technical bar through mentoring senior engineers, leading cross-functional task forces, and promoting engineering excellence and data-driven decision making
- Stay current with the evolving data landscape, adopting and advocating for emerging technologies and practices to shape long-term technical direction
Requirements
- 10+ years of experience in data engineering, with demonstrated senior or lead capacity
- Experience with federal government compliance and security requirements is highly desirable
- Expert-level SQL and ETL/ELT experience using Airflow and dbt
- Strong experience with MPP databases including Snowflake and Redshift
- Extensive hands-on AWS experience, including S3, Lambda, EMR, ECR, and EKS
- Expertise in HR data, including candidate lifecycle, employee records, compensation, and organizational data
- Experience building data models for recruiting analytics, engagement signals, and workforce planning metrics
- Familiarity with Workday data structures is a bonus
- Experience building and maintaining batch and real-time pipelines using Spark and Kafka
- Deep experience designing and working with lakehouse and warehouse architectures using Databricks and Snowflake
- Experience with modern file formats including Iceberg and Delta
- Demonstrated ability to integrate AI tools to optimize or redesign workflows and deliver measurable impact (efficiency and quality improvements)
- Proven history of hands-on collaboration with Data Science, Business, and Product teams
Technologies
- SQL, Airflow, dbt
- Snowflake, Redshift
- AWS S3, AWS Lambda, AWS EMR, AWS ECR, AWS EKS
- Spark, Kafka
- Databricks
- Iceberg, Delta
Location and Compensation
- Location: San Francisco, CA (hybrid)
- Salary: USD 197,000 - 270,600 per year
The Okta Experience
- Supporting Your Well-Being
- Driving Social Impact
- Developing Talent and Fostering Connection + Community