Senior Data Engineer, Agentic AI

This senior data engineering role focuses on designing and building high performance data surfaces to power Agentic AI workflows. You will leverage Snowflake, Databricks, and Microsoft Fabric with a strong emphasis on data quality, security, and low latency production systems.

Responsibilities

• Architect and implement the data ingestion, transformation, and serving pipelines using Snowflake, Databricks, and Microsoft Fabric.
• Develop and publish tightly defined data surfaces for autonomous agents, including APIs and semantic layers.
• Treat data quality as a core production signal, enabling real-time monitoring of freshness, completeness, and data drift.
• Collaborate with workflow engineers to refine data abstractions and optimize agent consumption efficiency.
• Maintain data lineage and documentation to ensure data products are easily discoverable and safe to use.
• Work with Security and Data Governance on data classification, masking, and Data Loss Prevention measures.
• Develop reusable platform components such as scalable connectors, transformation libraries, and testing harnesses.

Requirements

• At least 6 years of data engineering experience, with a minimum of 2 years in a cloud lakehouse or warehouse environment (examples include Snowflake, Databricks, BigQuery, Redshift).
• Proficient SQL and strong Python or Scala skills; experience delivering production-grade ETL/ELT pipelines.
• Experience processing and transforming unstructured data for AI consumption, including familiarity with chunking strategies and embedding models.
• Hands-on experience with orchestration and workflow tools (Airflow, dbt, Dagster, ADF) and with both batch and streaming patterns.
• Solid understanding of data modeling approaches—dimensional, Data Vault, or entity-centric—and their appropriate contexts.
• Experience exposing data to downstream consumers via APIs or semantic layers.

Technologies

• Snowflake
• Databricks
• Microsoft Fabric
• .NET
• Microsoft Agent Framework
• Azure OpenAI
• SQL
• Python
• Scala
• Airflow
• dbt
• Dagster
• ADF
• BigQuery
• Redshift
• OneLake
• Lakehouse
• Warehouse
• Data Factory
• Real-Time Intelligence
• Event Hubs
• Kafka
• Debezium
• Purview
• Collibra
• Unity
• Great Expectations
• Soda
• Monte Carlo

About the Team

• We are building a tight-knit, senior engineering group based in Austin, TX, dedicated to advancing enterprise automation at Light & Wonder. Our focus is to design, deliver, and scale production-grade Agentic AI workflows that tackle highly complex, meaningful tasks across the business.
• We operate like a high-functioning startup within the enterprise, prioritizing shipping over process, rigorous evaluation over opinions, and platform investments that accelerate future deployments. Our stack leans into the modern Microsoft ecosystem, anchored by the Microsoft Agent Framework (.NET), Azure OpenAI, and a sophisticated data backend powered by Snowflake, Databricks, and Microsoft Fabric. If you want to build resilient, multi-agent s

About the Role

• Data engineering for Agentic AI requires a shift in mindset: your primary consumers are autonomous agents making real-time decisions, not human analysts reading dashboards. As a Senior Data Engineer, you will craft robust, high-performance data surfaces, including APIs, semantic layers, and strongly typed contracts, that our multi-agent workflows rely on.
• Leveraging Snowflake, Databricks, and Microsoft Fabric, you will extend beyond basic ingestion and transformation. You will treat data quality, strict access scoping, and latency as critical production signals, ensuring the foundation of our AI systems remains fresh, secure, and structurally sound to prevent silent failures and enable scalable enterprise automation.

Physical Requirements

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the duties of this job, the employee is regularly required to sit, stand, walk, bend, use hands, operate a computer, and have specific vision abilities to include close and distance vision, and the ability to adj

Work Conditions

The work conditions are representative and typical of similar jobs in comparable organizations. Some domestic and international travel required.