Data Engineer II

The Data Engineer II role evaluates, designs, and develops business intelligence solutions across multiple technology stacks, with a focus on reliable reporting, scalable data pipelines, and Tableau-based analytics.

Location and Role Overview

Location: Scottsdale, AZ (hybrid)

This position works across business functions and technology partners to interpret metrics into actionable insight for planning, measuring, trending, and operational performance improvement. The role researches technology best practices, implements data frameworks, and aligns business intelligence efforts with strategic initiatives. Key outcomes include analysis of metric sources, monitoring data quality, defining logical inter-dependencies, developing datamarts, and building business process dashboards.

Responsibilities

• Partner with business users to define reporting and dashboard requirements, including identifying gaps in data, logic, and business understanding.
• Design and develop backend solutions for new data sources using the Cloudera technology stack.
• Build complex, visually engaging, interactive Tableau dashboards, scorecards, and reports, including related trends and projections.
• Perform in-depth data analysis to produce logical results, including cause-and-effect analysis based on available data.
• Design data ETL and data transformations to support production and ad-hoc analyses and reporting.
• Review industry best practices to guide strategic data platforms, tools, and processes.
• Recommend standards, policies, and procedures for the form, structure, and attributes of BI tools and systems.
• Provide support and training to business teams as needed.
• Write data infrastructure and analytics software tools for Data Science.
• Mentor and train interns.
• Guide Data Scientists on software engineering best practices.
• Collaborate with analytics leadership and engineers across Early Warning Services (EW) to support architectural and software enhancements to the Data Science platform.
• Collaborate with Data Science leadership to improve ETL and cluster computing.
• Support risk management commitments by protecting the integrity and confidentiality of systems and data.

Required Qualifications

• Bachelor’s degree, or education and experience typically obtained through a Bachelor’s degree.
• 2-4 years of progressive work experience with PySpark/Python/Spark/Scala for Data Engineering development in a Linux environment.
• Understanding of Tableau Server and Tableau Dashboard.
• Demonstrated ability with testing, problem solving, and analysis.
• Knowledge of principles, practices, and techniques for dashboard development, reporting, data modeling, ETL, and systems design.
• Experience working with SQL Spark.
• Software and data engineering experience with Python.
• Machine learning toolkits in Python/R.
• Experience building reusable frameworks for data ingestion and storage in Hadoop or AWS/S3.
• Experience with relational databases, including query optimization/tuning, indexing, and partitioning.
• Experience collaborating with internal engineering and technology teams to build data infrastructure in a regulated, enterprise environment.
• Strong communication skills.
• Background and drug screen.

Preferred Qualifications

• Prior demonstrated experience in 2-4 years.
• Scala/Java and PySpark experience.
• Experience with Hive/Impala and Linux.
• Fin-tech experience.

Technologies

• Cloudera, Tableau, Tableau Server
• PySpark, Python, Spark, Scala
• Linux, SQL
• Hadoop, AWS, S3, Hive, Impala
• Python/R

Compensation

Salary range (base):

• Phoenix, AZ / Chicago, IL: $83,000 - $110,000 per year
• New York, NY / San Francisco, CA: $99,000 - $132,000 per year

Candidates may also be eligible for a discretionary incentive plan and benefits.

Benefits

• Competitive medical (PPO/HDHP), dental, and vision plans, plus company contributions to your Health Savings Account (HSA) or pre-tax savings via FSA for commuting, health, and dependent care expenses.
• 401(k) Retirement Plan with a 100% Company Safe Harbor Match on your first 6% deferral immediately upon eligibility.
• Paid Time Off: Flexible Time Off for Exempt (salaried) employees, generous PTO for Non-Exempt (hourly) employees, plus 11 paid company holidays and a paid volunteer day.
• 12 weeks of Paid Parental Leave.
• Maven Family Planning support including services across parenting planning and return-to-work.

Physical Requirements

• Work is primarily sedentary and requires extensive computer use, including sitting for periods of approximately four hours.
• Occasional standing, walking, kneeling, and reaching may be required.
• Must be able to lift 10 pounds occasionally and/or negligible force frequently.
• Requires visual acuity and dexterity to view, prepare, and manipulate documents and office equipment, including personal computers.
• Requires the ability to communicate with internal and/or external customers.
• Employee must be able to perform essential functions and physical requirements with or without reasonable accommodation.

Work Authorization

Candidates must independently possess eligibility to work in the United States for any employer at the date of hire. This position is ineligible for employment visa sponsorship.