Staff, Data Engineer
Job Description
Design scalable data foundations that help power business insights. In this onsite role in Sunnyvale, you will build and maintain the data architectures and pipelines that support measurement, reporting, and decision-making at Walmart. The Measurement & Reporting Team builds enterprise attribution and reporting systems for Walmart Connect, working with distributed data pipelines and trusted analytics to support advertisers and retail intelligence across Walmart’s global ecosystem.
As a Staff Data Engineer, you will translate complex business needs into engineering solutions, strengthen data governance for privacy, quality, and security, and collaborate across functions to integrate data sources. The position is grounded in cloud and big data technologies, including Scala, Apache Kafka, Hive, and Cassandra.
What you’ll do
- Turn complex business requirements into scalable data engineering solutions aligned with organizational strategy.
- Design, develop, and maintain robust data pipelines and architectures using technologies such as Apache Kafka, Hive, and Cassandra.
- Implement data governance practices to support compliance with regulatory and ethical standards for data privacy, quality, and security.
- Collaborate with cross-functional teams to identify and integrate data sources for optimized analytics and reporting.
- Develop and test code for data transformation, integration, and storage in cloud and big data environments.
- Provide guidance on data modeling, metadata management, and documentation to support enterprise data initiatives.
What you’ll bring
- Scala proficiency and experience applying data engineering and architecture principles.
- Expertise building and managing data pipelines, data lakes, and ETL processes using Apache Kafka, Hive, and Cassandra.
- Strong knowledge of query languages, including SQL and NoSQL, for data modeling and integration.
- Experience with cloud platforms such as Google Cloud Dataproc and big data environments.
- Understanding of data governance, quality frameworks, and regulatory requirements related to data privacy and security.
- Ability to translate complex business requirements into scalable data solutions aligned with enterprise strategy.
- Familiarity with developing and implementing data strategy to drive business insights and value.
- Education and experience aligned to one of the listed combinations, including a Master’s degree in Computer Science with 2 years of software engineering or related field experience.
- Knowledge of accessibility best practices, including implementation of WCAG 2.2 AA standards and use of assistive technologies, to support an inclusive culture.
Tools and technologies
- Scala
- Apache Kafka
- Hive
- Cassandra
- SQL
- NoSQL
- Google Cloud Dataproc
Benefits
- Health benefits: medical, vision and dental coverage.
- Financial benefits: 401(k), stock purchase, and company-paid life insurance.
- Paid time off: PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
- Other benefits: short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.
- Live Better U: Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam’s Club facilities, with tuition, books, and fees completely paid for by Walmart.
Team and role focus
The Measurement & Reporting Team within the Global Data Foundation drives omnichannel measurement for Walmart Connect. They design and scale enterprise attribution and reporting systems that process billions of digital and in-store customer interactions daily, developing advanced multi-touch attribution models and resilient distributed data pipelines using Scala, Apache Kafka, and cloud-based data lakes.
Primary location: 815 Eleventh Ave, Sunnyvale, CA 94089-4731, United States of America