Columnar Olap Engineer Jobs

1 job found

Today

Data Engineer, Edge Services

TikTok USDS JV San Jose, CA

San Jose, CA

Today

$137k - $360k/yr Full time Big Data Columnar Olap Data Analysis

Apply Now

Job Description

Build real-time and offline data pipelines for TikTok USDS JV’s Edge and CDN platform, turning edge and CDN telemetry into insights for reliability and analytics.

Responsibilities

Design and implement high-concurrency streaming pipelines that ingest and process CDN measurement data, edge access logs, and infrastructure telemetry using Flink, Spark Streaming, or Kafka
Lead the design and maintenance of offline and real-time data warehouses, delivering robust ETL/ELT workflows that consolidate edge, network, and client-side data into a unified source of truth
Develop data and analytics products for intelligent SRE, including statistical and ML-assisted anomaly detection, alerting, and root-cause analysis for the global edge fleet
Create cost attribution and optimization datasets to quantify edge resource spend (bandwidth, compute, storage, peering) and identify optimization opportunities across PoPs, ISPs, and product lines
Build demand forecasting and capacity planning datasets that combine historical traffic, seasonality, growth, and event signals to support procurement and edge deployment planning
Design and deliver dashboards, compasses, and self-service analytics covering health, performance, cost, and growth of the Edge and CDN platform for engineers, leaders, and cross-functional partners
Implement proactive monitoring, data quality, and lineage frameworks to support pipeline stability and integrity of key business and reliability metrics

Requirements

Bachelor’s degree (or higher) in Computer Science, Data Engineering, or a related quantitative field
3+ years of data engineering experience building production-grade real-time and offline pipelines on Big Data platforms
Strong proficiency in SQL plus at least one of Python / Java / Scala / Go
Hands-on experience with distributed processing frameworks (Spark, Flink, or equivalent) and streaming systems (Kafka, Pulsar, or equivalent)
Experience operating at hyperscale with data lake or lakehouse architectures (Hudi, Iceberg, Delta) and OLAP engines (ClickHouse, Doris, Presto/Trino)
Domain experience with CDN, edge, networking, or large-scale infrastructure telemetry (access logs, RUM, NetFlow, peering data) and SRE/observability use cases such as anomaly detection and SLO analytics
Demonstrated leadership and self-direction; strong written and verbal communication skills, with willingness to teach others and learn new techniques

Technology Stack

Flink, Spark Streaming, Kafka, Spark
Python, Java, Scala, Go
Pulsar, Hudi, Iceberg, Delta
ClickHouse, Doris, Presto/Trino
ETL, ELT, data lakes, message queues, caches
OLAP engines, streaming engines, OLTP/OLAP warehouses

Benefits

Day one access to medical, dental, and vision insurance
401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
Eligible for additional discretionary bonuses/incentives and restricted stock units

Job Details

Location: San Jose, CA (onsite)
Salary: USD 136,800 - 359,720 per year
Base pay is part of the Total Package; additional discretionary bonuses/incentives and restricted stock units may apply
Compensation may vary based on qualifications, skills, competencies, experience, and location
Benefits may vary depending on the nature of employment and the country work location
USDS reserves the right to modify or change benefits programs at any time, with or without notice

About USDS

TikTok USDS Joint Venture LLC focuses on the safety and security of millions of Americans who create, discover, and connect with what they love on the apps the joint venture operates
Established in compliance with the Executive Order signed by President Trump on September 25, 2025
On-site presence across teams supports speed, alignment, and agility; shifting from a hybrid work model to a fully in-person schedule up to 5 days a week

Reasonable Accommodation

USDS provides reasonable accommodations in recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs, or other reasons protected by applicable laws
Contact: https://tinyurl.com/USDS-RA

View full job page →

Get Columnar Olap Engineer Jobs alerts

New Columnar Olap Engineer Jobs, daily.