Staff Data Engineer
Job Description
Staff Data Engineer role at Visa within Value Added Services - Digital Marketing & Engagement, building a data token platform and the pipelines and products that power analytics and machine learning. This hybrid position in Austin, TX combines large-scale engineering ownership with collaboration across product, analytics, and business teams.
You will design and enhance distributed data systems for batch and real-time processing, raise the bar on data quality and governance, and help drive adoption of new technologies through proof-of-concepts. The role also includes mentoring engineers and influencing best practices across data modeling, pipeline design, and operational excellence.
Responsibilities
- Design, build, and optimize large-scale data pipelines for batch and real-time processing
- Develop and maintain distributed data systems that are highly available, scalable, and resilient
- Lead initiatives to process, transform, and manage structured and unstructured data across platforms
- Drive development of data platforms and data products supporting analytics, reporting, and machine learning use cases
- Partner with product, analytics, and business teams to translate requirements into scalable data solutions
- Architect solutions using big data technologies such as Hadoop, Spark, and distributed data processing frameworks
- Build and optimize ETL/ELT pipelines while ensuring data quality, reliability, and performance
- Implement automation, monitoring, and observability across the data pipeline lifecycle
- Lead proof-of-concept efforts to evaluate and adopt new data engineering technologies
- Influence best practices in data engineering, including data modeling, pipeline design, and governance
- Mentor engineers and foster continuous learning and accountability
- Architect and implement secure, robust, and scalable data platforms
- Drive innovation through experimentation, prototyping, and rapid iteration
- Engage cross-functionally to align on technical and business outcomes
Requirements
- 5+ years of relevant work experience with a Bachelor’s degree; or meet the alternative experience thresholds for advanced degrees or PhD (as applicable)
- Demonstrated leadership delivering high-quality, large-scale enterprise-class applications
- Solid big data engineering experience with knowledge of Hadoop, Apache Spark, Python, and SQL
- Experience with Docker and Kubernetes for containerization
- Ability to create and manage large-scale data pipelines and machine learning models
- Experience developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models
- Proficiency with technologies such as Kafka, Redis, Flink, TensorFlow, Triton, and AWS
- Skilled in Unix/Shell or Python scripting and scheduling tools such as Airflow and Control-M
- Familiarity with Agile, TDD, CI/CD, and various databases
- Proven track record building reliable, scalable, operable applications
- Ability to manage component security analysis and collaborate with security teams
- Strong work ethic, focus on immediate goals, and experience as a technical leader
- Passion for mentoring and helping juniors grow professionally
- Excellent communication and interpersonal skills with a strong team approach
Technology Stack
Hadoop, Spark (Apache Spark), Python, SQL, distributed data processing frameworks, ETL, ELT, Docker, Kubernetes, Kafka, Redis, Flink, TensorFlow, Triton, AWS, Unix/Shell, Airflow, Control-M, Agile, TDD, CI/CD, databases
Benefits
- Medical
- Dental
- Vision
- 401(k)
- FSA/HSA
- Life Insurance
- Paid Time Off
- Wellness Program
- Bonus and equity (may be eligible)
Salary: USD 133,300 - 213,400 per year. Salary may vary based on job-related factors including knowledge, skills, experience, and location.
Work hours: Varies upon the needs of the department.
Travel requirements: 5-10% of the time.
Work setting: Office setting. The role requires sitting and standing at a desk, communicating in person and by telephone, and frequently operating standard office equipment such as telephones and computers.