Distributed Sql Engineer Jobs

1 job found

Today

Staff Data Engineer - Data Platform

Trend Micro Austin, TX

Austin, TX

Today

Full time Big Data Bigdata Bigquery

Apply Now

Job Description

Join Trend Micro in Austin, TX to design and build the Vision One Data Platform foundation that powers ingestion, CDC, governance, discovery, and governed self-service transformation.

Responsibilities

Design and build the Vision One Data Platform across ingestion, replication, transformation, governance, discovery, and serving capabilities.
Create scalable data pipelines and change-data-capture (CDC) architectures using technologies such as Datastream and similar streaming or replication tools.
Enable self-service dbt for Vision One OLTP data sources so product teams can transform, model, test, document, and expose data using governed capabilities.
Define patterns for safely extracting and replicating data from OLTP and distributed SQL systems into analytical and downstream environments.
Design platform architectures for distributed SQL technologies such as YugabyteDB, CockroachDB, or similar.
Partner with modern analytical processing technologies, including Databricks, to support large-scale processing and analytics.
Develop a comprehensive data catalog and metadata foundation to help teams and AI agents understand what data exists, where it comes from, what it means, and how to use it.
Implement semantic data discovery so engineers, analysts, applications, and AI agents can find relevant data using business meaning instead of only database or schema names.
Establish governance standards for ownership, lineage, schemas, quality, access control, and retention and lifecycle management.
Create reusable data platform primitives and APIs that product teams consume as self-service capabilities.
Build automation for data quality, schema evolution, lineage, observability, and freshness monitoring.
Design for continuously evolving product schemas while avoiding duplication and excessive operational overhead.
Collaborate with security and platform engineering teams to implement appropriate fine-grained access controls across databases, schemas, tables, and data products.
Support the source-of-truth architecture for Vision One data while minimizing unnecessary duplication.
Provide technical leadership and architectural guidance to other data and product engineering teams.
Drive engineering standards focused on reliability, scalability, performance, cost efficiency, and operational excellence.

Requirements

8+ years of experience in data engineering, distributed systems, backend engineering, or a related field.
Strong background designing and building large-scale data platforms and data pipelines.
Deep understanding of OLTP and OLAP architectures and the tradeoffs between them.
Hands-on experience with CDC, data replication, and streaming architectures.
Strong SQL skills and experience working with relational databases at scale.
Experience with distributed SQL databases including YugabyteDB, CockroachDB, Spanner, or similar.
Experience building data transformation workflows with dbt or comparable modeling frameworks.
Experience with modern analytical/data platforms such as Databricks, Spark, Trino, Snowflake, BigQuery, or equivalent.
Strong understanding of data governance concepts: metadata, lineage, data quality, ownership, access control, and data catalogs.
Experience designing systems that support self-service data consumption and transformation.
Strong software engineering fundamentals including API design, testing, CI/CD, observability, and production operations.
Ability to work across organizational boundaries and influence architecture and engineering standards without relying solely on formal authority.

Technologies

dbt
Datastream
YugabyteDB
CockroachDB
Databricks
Spark
Trino
Snowflake
BigQuery
Spanner
CDC
Kafka
Debezium
OLTP
OLAP

Preferred Qualifications

Experience building a company-wide or platform-level Data Platform rather than individual product pipelines.
Experience with Datastream, Debezium, Kafka, or similar CDC and streaming technologies.
Experience with YugabyteDB or CockroachDB in production environments.
Experience operating Databricks or similar distributed data-processing platforms.
Experience designing data catalogs, semantic layers, knowledge graphs, or ontology-driven data discovery.
Experience building platforms that expose data to AI and agentic applications.
Experience with data mesh, data products, or domain-oriented data architectures.
Experience implementing fine-grained authorization for data platforms.
Experience managing large-scale telemetry, security, observability, or other high-volume data.
Experience balancing data quality, query performance, platform reliability, and infrastructure cost.

What Success Looks Like

Vision One data can be discovered through a common semantic layer rather than requiring teams to know every underlying database and schema.
Product teams can use dbt as a governed self-service capability across OLTP data.
Lineage, ownership, quality, and access policies are built into the platform rather than handled manually.
Reliable data movement from distributed OLTP systems into analytical and downstream systems via standardized CDC and streaming patterns.
Product teams can consume platform capabilities without repeatedly building their own ingestion, transformation, governance, and discovery infrastructure.
A trusted source of truth that minimizes unnecessary data copies.
The platform supports both traditional analytics and AI and agentic experiences across Vision One.

Engineering Leadership

As a Staff Engineer, operate beyond a single team by shaping architecture, establishing technical standards, mentoring engineers, and driving cross-team adoption.
Go deep into implementation details while also planning long-term architecture for a large-scale, multi-product security data platform.

Benefits

Comprehensive medical, dental and vision insurance
Life insurance
Short & Long Term Disability
Pre-partum, maternity, parental and medical leave
Mental Health Wellness Program
Adoption Assistance
Wellness Incentive
Pet Insurance
401(k) with company match
Paid Time Off
14 Annual Holidays
Tuition Assistance
Employee Resource Groups

What We Offer

Benefit options for you and your family through TrendAI.
Competitive compensation with bonus opportunity tied to company performance.
Ongoing learning and broad technology opportunities.
Work-life balance supported by team activities and a culture of equity, inclusion, and collaboration.

Location: Austin, TX (onsite)

Experience: 8+ years

View full job page →

Get Distributed Sql Engineer Jobs alerts

New Distributed Sql Engineer Jobs, daily.