Staff Software Data Engineer
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Operations
Cloud Platform
Cloud Platforms
Data Analysis
Data Analytics
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Elasticsearch
Information Technology (IT)
Integration
Pyspark
Spark
SQL
Streaming Data
Job Description
Build enterprise-scale data engineering pipelines and features for Intuit’s QuickBooks Capital and Lending team.
Responsibilities
- Translate functional requirements into technical designs and specifications; implement, code, and test solutions
- Size work for medium to large complexity items and manage timelines and delivery outcomes
- Design and develop software using data engineering technologies
- Spend approximately 90% of time hands-on with designing, coding, testing, and supporting production systems through on-call rotations
- Identify and resolve defects across testing, pre-production, production, and post-release patching
- Partner cross-functionally with product management, other engineering teams, and business units to drive results
- Apply Agile Development practices, including SCRUM or Extreme Programming methodologies
Requirements
- 7+ years developing data engineering pipelines using technologies including Python, PySpark, Spark, SQL, DataBricks, AWS, Elastic Search, and Kafka
- 7+ years working with BigData technologies
- BS/MS in computer science or equivalent work experience
- Strong capability with Python and Spark, including the ability to understand and work within large existing codebases
- Experience across the Software Development Life Cycle (SDLC)
- Proven experience building and supporting large-scale enterprise data engineering pipelines and data featurization
- Demonstrated commitment to engineering quality and operational excellence, including production support via quarterly on-call rotations to monitor systems and resolve production errors and incidents
- Strong communication skills, including the ability to explain complex technical issues to technical and non-technical audiences
- Strong understanding of the software design and architecture process
- Experience with unit testing and Test-Driven Development (TDD)
Technologies
- Python
- PySpark
- Spark
- SQL
- DataBricks
- AWS
- Elastic Search
- Kafka
Location: Mountain View, CA (onsite)
Compensation: USD 202,500 - 274,000 per year