The Online Senior Data Engineer role is based onsite in Atlanta, GA, focusing on establishing data operation standards and building scalable data pipelines and analytics capabilities to support Home Depot's online data needs.
Responsibilities
- 20%: Business Collaboration Leverage substantial business knowledge to shape data solutions, build trust with internal customers and cross functional teams, educate partners on advanced analytics, align IT requirements with business problems, and pursue opportunities to use data science as a competitive edge.
- 30%: Project Management and Team Support Partner with project teams and business stakeholders to define goals, guide prioritization, ensure quality, mentor junior staff, coordinate workload and resources, and assist with recruiting efforts.
- 35%: Solution Development Deliver tasks with efficiency and quality, apply appropriate advanced analytical methods, communicate insights to both technical and non-technical leaders, prepare progress reports and presentations, and articulate the impact of recommendations to drive alignment and implementation.
- 15%: Technical Exploration and Development Lead requirements gathering, design, and development of complex applications; continually seek knowledge on advances in analytics and data sources; contribute to replicable solutions that improve predictive and prescriptive analytics.
Requirements
- Must be 18 years of age or older.
- Must be legally permitted to work in the United States.
Technologies
- Python
- Google BigQuery
- PySpark
- Airflow
- DataProc
- SQL
- JavaScript
- React
- Nucleus
- Retina
- KPI Shield
- Alert Goose
Direct Manager / Reports
This position typically reports to a Manager or above and has 0 direct reports.
Travel Requirements
Typically requires overnight travel 5% to 20% of the time.
Physical Requirements
Primarily seated with occasional movement; lifting light objects may be required rarely.
Working Conditions
Based in a comfortable indoor environment; unpleasant conditions are infrequent and not objectionable.
Minimum Qualifications
- Must be 18 years of age or older.
- Must be legally permitted to work in the United States.
Preferred Qualifications
- Bachelor's or Master’s degree in a quantitative field (Analytics, Computer Science, Mathematics, Physics, Statistics, etc.) or relevant work experience.
- 5+ years of relevant work experience.
- Proven experience in predictive modeling, data mining, and data analysis.
- Experience developing and testing ETL jobs and pipelines, configuring orchestration, automated CI/CD, scripting automation, and supporting production data pipelines.
- Proficiency in Python for data engineering tasks.
- Experience defining and managing metadata and rules for ETL processes.
- Experience building Batch and Streaming data pipelines.
- Direct experience writing analytical SQL queries and performance tuning.
- Ability to stitch and consolidate data from multiple sources.
- Familiarity with JavaScript, front-end frameworks (React, Nucleus), and QA apps (Retina, KPI Shield, Alert Goose).
- Ability to generate data tags for site data and code in Python and Google BigQuery to enrich data from multiple sources.
- Proven ability to use PySpark, Airflow, and DataProc to engineer and automate data flow pipelines.
- Capacity to optimize pipeline runtimes and reduce slot/storage costs.
- Ability to prioritize requests and manage a product roadmap.
- Coaching experience to help junior engineers improve code quality and data engineering practices.
- Strong verbal and written communication skills across all levels.
Minimum Education
The knowledge, skills, and abilities are typically obtained through completion of a bachelor’s degree or an equivalent degree in a related field.
Preferred Education
The knowledge, skills, and abilities are typically obtained through completion of a master’s degree or an equivalent degree in a related field.
Minimum Years of Work Experience
4
Preferred Years of Work Experience
5
Minimum Leadership Experience
No prior leadership experience required.
Preferred Leadership Experience
No prior leadership experience expected.
Certifications
None
Competencies
- Action Oriented
- Collaborates
- Drives Engagement
- Communicates Effectively
- Customer Focus
- Drives Results
- Manages Conflict
