Visa Technology and Operations LLC is hiring a Senior Consultant - Data Engineer to support Data Platforms, building and operating petabyte-scale data processing and delivery capabilities for core payment domains. This onsite role in Foster City, CA includes technical leadership, reliability and observability improvements, and close collaboration across cross-functional teams.
Role Overview
Visa’s Data Platforms organization provides the foundational data ecosystem that supports critical business capabilities. Teams develop large-scale platforms for authorization, clearing, settlement, and other core payment data domains, while enabling data products, analytics, and business insights across Visa. This position works within a cross-functional Agile team focused on scalable data solutions, modernizing data delivery, and advancing Master Data Management and data platform initiatives.
As part of the role, you will design and build platforms that process and manage data at petabyte scale, ensuring accessibility, reliability, security, and optimization for internal and customer-facing applications. Digital fluency is expected, including the ability to leverage emerging technologies such as Generative AI tools (for example Microsoft Copilot, ChatGPT, and LLM-powered engineering solutions) to improve productivity and software delivery practices.
Key Responsibilities
- Collaborate with product managers, architects, and business stakeholders to define requirements and translate business needs into scalable data platform solutions.
- Design, develop, and enhance distributed data processing systems supporting Visa’s payment, settlement, authorization, and analytics workloads.
- Build and maintain high-performance, reliable data pipelines that process and deliver large data volumes across platforms, products, and business domains.
- Contribute to the evolution of data platform architecture, data delivery capabilities, and Master Data Management solutions.
- Lead technical design discussions, architecture reviews, and engineering decision-making for complex initiatives.
- Develop clean, scalable, maintainable, reusable code aligned to engineering best practices and platform standards.
- Drive improvements in reliability, observability, automation, performance, and operational excellence.
- Lead code reviews and mentor engineers to support technical excellence and continuous learning.
- Troubleshoot and resolve complex production issues, while identifying opportunities to automate manual processes and reduce operational risk.
- Develop comprehensive testing strategies and quality assurance practices for robust, reliable data solutions.
- Coordinate with engineers, data scientists, architects, product managers, and platform teams to deliver business-critical capabilities.
- Identify, analyze, and proactively address data quality, performance, scalability, governance, and security challenges.
- Support project planning, estimation, and delivery while balancing business priorities, technical debt, and long-term platform health.
Required Qualifications
- Strong working knowledge of SQL, NoSQL, graph databases, and RESTful APIs.
- Expert-level experience with Spark, Hive-based technologies, and broader Big Data development tools and platforms.
- Extensive hands-on programming experience in Java, Scala, or Python, including the ability to quickly develop clean, production-quality prototypes and core application components.
- Demonstrated success leading large-scale, end-to-end projects that deliver measurable business impact from concept through production delivery.
- Strong understanding of algorithms, data structures, and core computer science fundamentals.
- Practical experience with data modeling for both relational and non-relational database systems.
- Demonstrated leadership behaviors, including a positive mindset, quick learning ability, collaboration, courage in leadership, and strong customer obsession.
Preferred Qualifications
- Practical experience applying Generative AI and Large Language Models in data engineering, including leading initiatives that leverage GenAI to improve productivity and operational efficiency.
- Experience collaborating with data scientists and machine learning teams, with the ability to discuss major machine learning paradigms, algorithms, and common software tools.
- Hands-on experience designing, building, and managing reliable data pipelines that move data across systems using tools such as Apache Airflow.
- Proficiency with Git and experience implementing CI/CD pipelines for automated testing, deployment, and release management.
- Experience mentoring junior engineers and providing technical leadership.
- Experience collaborating with cross-functional teams to deliver solutions, including driving security assessment processes to support code quality, refining code plans for architecture, and sharing learnings with the team.
- Ability to manage multiple competing priorities in a fast-paced, dynamic environment.
- Experience supporting data quality, data lineage, data governance, compliance, and security requirements within data engineering environments.
Technologies
- SQL, NoSQL, graph databases, RESTful APIs
- Spark, Hive, Big Data
- Java, Scala, Python
- Apache Airflow, Git, CI/CD
- Generative AI, Large Language Models, Microsoft Copilot, ChatGPT, LLM-powered engineering solutions
Compensation and Location
- Location: Foster City, CA (onsite)
- Salary: USD 180,600 - 289,300 per year
- Minimum Experience: 8 years
- Education: Bachelor’s degree
Information for US Applicants: For roles located in the US, the estimated salary range is $180,600.00 to $289,300.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary based on job-related factors such as knowledge, skills, experience, and location. This position may be eligible for bonus and equity.
Benefits
- Medical
- Dental
- Vision
- 401(k)
- FSA/HSA
- Life Insurance
- Paid Time Off
- Wellness Program
Work Schedule, Travel, and Work Environment
- Work Hours: Varies based on the needs of the department.
- Travel Requirements: 5-10% of the time.
- Work Environment: Office setting.
The role requires the incumbent to sit and stand at a desk, communicate in person and by telephone, and frequently operate standard office equipment such as telephones and computers.
Equal Employment Opportunity
Visa is an Equal Employment Opportunity employer. Qualified applicants receive consideration without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Visa also considers qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.