Staff Data Engineer - Data Platform

Join Trend Micro in Austin, TX to design and build the Vision One Data Platform foundation that powers ingestion, CDC, governance, discovery, and governed self-service transformation.

Responsibilities

• Design and build the Vision One Data Platform across ingestion, replication, transformation, governance, discovery, and serving capabilities.
• Create scalable data pipelines and change-data-capture (CDC) architectures using technologies such as Datastream and similar streaming or replication tools.
• Enable self-service dbt for Vision One OLTP data sources so product teams can transform, model, test, document, and expose data using governed capabilities.
• Define patterns for safely extracting and replicating data from OLTP and distributed SQL systems into analytical and downstream environments.
• Design platform architectures for distributed SQL technologies such as YugabyteDB, CockroachDB, or similar.
• Partner with modern analytical processing technologies, including Databricks, to support large-scale processing and analytics.
• Develop a comprehensive data catalog and metadata foundation to help teams and AI agents understand what data exists, where it comes from, what it means, and how to use it.
• Implement semantic data discovery so engineers, analysts, applications, and AI agents can find relevant data using business meaning instead of only database or schema names.
• Establish governance standards for ownership, lineage, schemas, quality, access control, and retention and lifecycle management.
• Create reusable data platform primitives and APIs that product teams consume as self-service capabilities.
• Build automation for data quality, schema evolution, lineage, observability, and freshness monitoring.
• Design for continuously evolving product schemas while avoiding duplication and excessive operational overhead.
• Collaborate with security and platform engineering teams to implement appropriate fine-grained access controls across databases, schemas, tables, and data products.
• Support the source-of-truth architecture for Vision One data while minimizing unnecessary duplication.
• Provide technical leadership and architectural guidance to other data and product engineering teams.
• Drive engineering standards focused on reliability, scalability, performance, cost efficiency, and operational excellence.

Requirements

• 8+ years of experience in data engineering, distributed systems, backend engineering, or a related field.
• Strong background designing and building large-scale data platforms and data pipelines.
• Deep understanding of OLTP and OLAP architectures and the tradeoffs between them.
• Hands-on experience with CDC, data replication, and streaming architectures.
• Strong SQL skills and experience working with relational databases at scale.
• Experience with distributed SQL databases including YugabyteDB, CockroachDB, Spanner, or similar.
• Experience building data transformation workflows with dbt or comparable modeling frameworks.
• Experience with modern analytical/data platforms such as Databricks, Spark, Trino, Snowflake, BigQuery, or equivalent.
• Strong understanding of data governance concepts: metadata, lineage, data quality, ownership, access control, and data catalogs.
• Experience designing systems that support self-service data consumption and transformation.
• Strong software engineering fundamentals including API design, testing, CI/CD, observability, and production operations.
• Ability to work across organizational boundaries and influence architecture and engineering standards without relying solely on formal authority.

Technologies

• dbt
• Datastream
• YugabyteDB
• CockroachDB
• Databricks
• Spark
• Trino
• Snowflake
• BigQuery
• Spanner
• CDC
• Kafka
• Debezium
• OLTP
• OLAP

Preferred Qualifications

• Experience building a company-wide or platform-level Data Platform rather than individual product pipelines.
• Experience with Datastream, Debezium, Kafka, or similar CDC and streaming technologies.
• Experience with YugabyteDB or CockroachDB in production environments.
• Experience operating Databricks or similar distributed data-processing platforms.
• Experience designing data catalogs, semantic layers, knowledge graphs, or ontology-driven data discovery.
• Experience building platforms that expose data to AI and agentic applications.
• Experience with data mesh, data products, or domain-oriented data architectures.
• Experience implementing fine-grained authorization for data platforms.
• Experience managing large-scale telemetry, security, observability, or other high-volume data.
• Experience balancing data quality, query performance, platform reliability, and infrastructure cost.

What Success Looks Like

• Vision One data can be discovered through a common semantic layer rather than requiring teams to know every underlying database and schema.
• Product teams can use dbt as a governed self-service capability across OLTP data.
• Lineage, ownership, quality, and access policies are built into the platform rather than handled manually.
• Reliable data movement from distributed OLTP systems into analytical and downstream systems via standardized CDC and streaming patterns.
• Product teams can consume platform capabilities without repeatedly building their own ingestion, transformation, governance, and discovery infrastructure.
• A trusted source of truth that minimizes unnecessary data copies.
• The platform supports both traditional analytics and AI and agentic experiences across Vision One.

Engineering Leadership

• As a Staff Engineer, operate beyond a single team by shaping architecture, establishing technical standards, mentoring engineers, and driving cross-team adoption.
• Go deep into implementation details while also planning long-term architecture for a large-scale, multi-product security data platform.

Benefits

• Comprehensive medical, dental and vision insurance
• Life insurance
• Short & Long Term Disability
• Pre-partum, maternity, parental and medical leave
• Mental Health Wellness Program
• Adoption Assistance
• Wellness Incentive
• Pet Insurance
• 401(k) with company match
• Paid Time Off
• 14 Annual Holidays
• Tuition Assistance
• Employee Resource Groups

What We Offer

• Benefit options for you and your family through TrendAI.
• Competitive compensation with bonus opportunity tied to company performance.
• Ongoing learning and broad technology opportunities.
• Work-life balance supported by team activities and a culture of equity, inclusion, and collaboration.

Location: Austin, TX (onsite)

Experience: 8+ years