EngineerJobs.io
← Back to all jobs

This position is no longer accepting applications

Closed on October 29, 2026.

This role is filled — get an email when new Data Processing roles open on EngineerJobs.io:

Job Description

Join Trend Micro in Austin, TX to design and build the Vision One Data Platform foundation that powers ingestion, CDC, governance, discovery, and governed self-service transformation.

Responsibilities

  • Design and build the Vision One Data Platform across ingestion, replication, transformation, governance, discovery, and serving capabilities.
  • Create scalable data pipelines and change-data-capture (CDC) architectures using technologies such as Datastream and similar streaming or replication tools.
  • Enable self-service dbt for Vision One OLTP data sources so product teams can transform, model, test, document, and expose data using governed capabilities.
  • Define patterns for safely extracting and replicating data from OLTP and distributed SQL systems into analytical and downstream environments.
  • Design platform architectures for distributed SQL technologies such as YugabyteDB, CockroachDB, or similar.
  • Partner with modern analytical processing technologies, including Databricks, to support large-scale processing and analytics.
  • Develop a comprehensive data catalog and metadata foundation to help teams and AI agents understand what data exists, where it comes from, what it means, and how to use it.
  • Implement semantic data discovery so engineers, analysts, applications, and AI agents can find relevant data using business meaning instead of only database or schema names.
  • Establish governance standards for ownership, lineage, schemas, quality, access control, and retention and lifecycle management.
  • Create reusable data platform primitives and APIs that product teams consume as self-service capabilities.
  • Build automation for data quality, schema evolution, lineage, observability, and freshness monitoring.
  • Design for continuously evolving product schemas while avoiding duplication and excessive operational overhead.
  • Collaborate with security and platform engineering teams to implement appropriate fine-grained access controls across databases, schemas, tables, and data products.
  • Support the source-of-truth architecture for Vision One data while minimizing unnecessary duplication.
  • Provide technical leadership and architectural guidance to other data and product engineering teams.
  • Drive engineering standards focused on reliability, scalability, performance, cost efficiency, and operational excellence.

Requirements

  • 8+ years of experience in data engineering, distributed systems, backend engineering, or a related field.
  • Strong background designing and building large-scale data platforms and data pipelines.
  • Deep understanding of OLTP and OLAP architectures and the tradeoffs between them.
  • Hands-on experience with CDC, data replication, and streaming architectures.
  • Strong SQL skills and experience working with relational databases at scale.
  • Experience with distributed SQL databases including YugabyteDB, CockroachDB, Spanner, or similar.
  • Experience building data transformation workflows with dbt or comparable modeling frameworks.
  • Experience with modern analytical/data platforms such as Databricks, Spark, Trino, Snowflake, BigQuery, or equivalent.
  • Strong understanding of data governance concepts: metadata, lineage, data quality, ownership, access control, and data catalogs.
  • Experience designing systems that support self-service data consumption and transformation.
  • Strong software engineering fundamentals including API design, testing, CI/CD, observability, and production operations.
  • Ability to work across organizational boundaries and influence architecture and engineering standards without relying solely on formal authority.

Technologies

  • dbt
  • Datastream
  • YugabyteDB
  • CockroachDB
  • Databricks
  • Spark
  • Trino
  • Snowflake
  • BigQuery
  • Spanner
  • CDC
  • Kafka
  • Debezium
  • OLTP
  • OLAP

Preferred Qualifications

  • Experience building a company-wide or platform-level Data Platform rather than individual product pipelines.
  • Experience with Datastream, Debezium, Kafka, or similar CDC and streaming technologies.
  • Experience with YugabyteDB or CockroachDB in production environments.
  • Experience operating Databricks or similar distributed data-processing platforms.
  • Experience designing data catalogs, semantic layers, knowledge graphs, or ontology-driven data discovery.
  • Experience building platforms that expose data to AI and agentic applications.
  • Experience with data mesh, data products, or domain-oriented data architectures.
  • Experience implementing fine-grained authorization for data platforms.
  • Experience managing large-scale telemetry, security, observability, or other high-volume data.
  • Experience balancing data quality, query performance, platform reliability, and infrastructure cost.

What Success Looks Like

  • Vision One data can be discovered through a common semantic layer rather than requiring teams to know every underlying database and schema.
  • Product teams can use dbt as a governed self-service capability across OLTP data.
  • Lineage, ownership, quality, and access policies are built into the platform rather than handled manually.
  • Reliable data movement from distributed OLTP systems into analytical and downstream systems via standardized CDC and streaming patterns.
  • Product teams can consume platform capabilities without repeatedly building their own ingestion, transformation, governance, and discovery infrastructure.
  • A trusted source of truth that minimizes unnecessary data copies.
  • The platform supports both traditional analytics and AI and agentic experiences across Vision One.

Engineering Leadership

  • As a Staff Engineer, operate beyond a single team by shaping architecture, establishing technical standards, mentoring engineers, and driving cross-team adoption.
  • Go deep into implementation details while also planning long-term architecture for a large-scale, multi-product security data platform.

Benefits

  • Comprehensive medical, dental and vision insurance
  • Life insurance
  • Short & Long Term Disability
  • Pre-partum, maternity, parental and medical leave
  • Mental Health Wellness Program
  • Adoption Assistance
  • Wellness Incentive
  • Pet Insurance
  • 401(k) with company match
  • Paid Time Off
  • 14 Annual Holidays
  • Tuition Assistance
  • Employee Resource Groups

What We Offer

  • Benefit options for you and your family through TrendAI.
  • Competitive compensation with bonus opportunity tied to company performance.
  • Ongoing learning and broad technology opportunities.
  • Work-life balance supported by team activities and a culture of equity, inclusion, and collaboration.

Location: Austin, TX (onsite)

Experience: 8+ years

Similar Jobs