EngineerJobs.io
← Back to all jobs
TikTok USDS JV

Data Engineer, Edge Services

TikTok USDS JV
San Jose, CA $137k - $360k/yr Full time Posted 7d ago
Big Data Columnar Olap Data Analysis Data Architecture Data Engineer Data Integration Data Lakes Data Pipeline Data Pipelines Data Platform Data Processing Data Warehouse ETL Flink Kafka Spark Streaming Stream Processing Streaming Data
Apply Now

Job Description

Build real-time and offline data pipelines for TikTok USDS JV’s Edge and CDN platform, turning edge and CDN telemetry into insights for reliability and analytics.

Responsibilities

  • Design and implement high-concurrency streaming pipelines that ingest and process CDN measurement data, edge access logs, and infrastructure telemetry using Flink, Spark Streaming, or Kafka
  • Lead the design and maintenance of offline and real-time data warehouses, delivering robust ETL/ELT workflows that consolidate edge, network, and client-side data into a unified source of truth
  • Develop data and analytics products for intelligent SRE, including statistical and ML-assisted anomaly detection, alerting, and root-cause analysis for the global edge fleet
  • Create cost attribution and optimization datasets to quantify edge resource spend (bandwidth, compute, storage, peering) and identify optimization opportunities across PoPs, ISPs, and product lines
  • Build demand forecasting and capacity planning datasets that combine historical traffic, seasonality, growth, and event signals to support procurement and edge deployment planning
  • Design and deliver dashboards, compasses, and self-service analytics covering health, performance, cost, and growth of the Edge and CDN platform for engineers, leaders, and cross-functional partners
  • Implement proactive monitoring, data quality, and lineage frameworks to support pipeline stability and integrity of key business and reliability metrics

Requirements

  • Bachelor’s degree (or higher) in Computer Science, Data Engineering, or a related quantitative field
  • 3+ years of data engineering experience building production-grade real-time and offline pipelines on Big Data platforms
  • Strong proficiency in SQL plus at least one of Python / Java / Scala / Go
  • Hands-on experience with distributed processing frameworks (Spark, Flink, or equivalent) and streaming systems (Kafka, Pulsar, or equivalent)
  • Experience operating at hyperscale with data lake or lakehouse architectures (Hudi, Iceberg, Delta) and OLAP engines (ClickHouse, Doris, Presto/Trino)
  • Domain experience with CDN, edge, networking, or large-scale infrastructure telemetry (access logs, RUM, NetFlow, peering data) and SRE/observability use cases such as anomaly detection and SLO analytics
  • Demonstrated leadership and self-direction; strong written and verbal communication skills, with willingness to teach others and learn new techniques

Technology Stack

  • Flink, Spark Streaming, Kafka, Spark
  • Python, Java, Scala, Go
  • Pulsar, Hudi, Iceberg, Delta
  • ClickHouse, Doris, Presto/Trino
  • ETL, ELT, data lakes, message queues, caches
  • OLAP engines, streaming engines, OLTP/OLAP warehouses

Benefits

  • Day one access to medical, dental, and vision insurance
  • 401(k) savings plan with company match
  • Paid parental leave
  • Short-term and long-term disability coverage
  • Life insurance
  • Wellbeing benefits
  • 10 paid holidays per year
  • 10 paid sick days per year
  • 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
  • Eligible for additional discretionary bonuses/incentives and restricted stock units

Job Details

  • Location: San Jose, CA (onsite)
  • Salary: USD 136,800 - 359,720 per year
  • Base pay is part of the Total Package; additional discretionary bonuses/incentives and restricted stock units may apply
  • Compensation may vary based on qualifications, skills, competencies, experience, and location
  • Benefits may vary depending on the nature of employment and the country work location
  • USDS reserves the right to modify or change benefits programs at any time, with or without notice

About USDS

  • TikTok USDS Joint Venture LLC focuses on the safety and security of millions of Americans who create, discover, and connect with what they love on the apps the joint venture operates
  • Established in compliance with the Executive Order signed by President Trump on September 25, 2025
  • On-site presence across teams supports speed, alignment, and agility; shifting from a hybrid work model to a fully in-person schedule up to 5 days a week

Reasonable Accommodation

  • USDS provides reasonable accommodations in recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs, or other reasons protected by applicable laws
  • Contact: https://tinyurl.com/USDS-RA

Similar Jobs