Data Engineer
Analytics
Automation Developer
Azure Data Engineer
Big Data
Bigdata
Business Analytics
Business Intelligence
Business Intelligence Tools
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Analytics Tools
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Visualization
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
Databricks Lakehouse Platform
Digital Marketing
ETL
Hr Technology
Informatica
Information Technology (IT)
Microsoft
Microsoft 365
Microsoft Office
Microsoft Power Platform
Office 365
Office Tools
Power BI
Power Platform
Product Management
Programming
Programming Language
Programming Languages
Pyspark
Reporting and Analytics
Software Development
Spark
SQL
Visual Design
Job Description
Tennessee Oncology is seeking a hands-on Data Engineer to design and maintain reliable data solutions that support reporting, analytics, and business intelligence. In this onsite role in Nashville, TN, you will build and integrate governed datasets, support Power BI Report Server consumption, and help ensure data quality, security, documentation, and performance across production pipelines.
As a key contributor, you will develop ingestion and transformation pipelines in Databricks, create scalable lakehouse structures, and deliver curated datasets and semantic models that support consistent metrics and dependable refresh behavior.
Responsibilities
- Design, build, test, deploy, and support data ingestion and transformation pipelines in Databricks using SQL, Python, PySpark, notebooks, and workflows
- Connect to and integrate data from relational databases, APIs, files, cloud platforms, vendor systems, and other enterprise data sources
- Profile, clean, standardize, enrich, and validate data to ensure downstream reporting and analytical datasets are accurate and consistent
- Develop and maintain scalable lakehouse data structures using Parquet and Delta Lake, including partitioning, schema management, table design, and file optimization
- Create and maintain SQL queries, views, stored procedures, functions, and data models for transformation, reconciliation, reporting, and analysis
- Build curated datasets, semantic models, reports, dashboards, and visualizations for Power BI Report Server, coordinating with report developers and business users to support accurate presentation, consistent metric definitions, reliable refreshes, and performance
- Implement data quality controls, reconciliation checks, exception handling, logging, and alerting across data pipelines
- Investigate pipeline failures, unexpected results, refresh problems, and source-system changes, coordinating corrective action through completion
- Monitor scheduled jobs, data freshness, storage utilization, and query performance to improve operational reliability, scalability, and cost efficiency
- Apply established data architecture standards including naming, metadata, lineage, retention, access, privacy, and lifecycle requirements
- Protect sensitive and regulated information using least-privilege access, secure data handling, appropriate masking, and organizational security and compliance requirements
- Collaborate with business users and technical teams to define source behavior, business rules, reporting needs, and acceptance criteria
- Document source-to-target mappings, business rules, transformations, dependencies, data models, operational procedures, and troubleshooting guidance
- Use version control, code review, testing, deployment, and change-management practices to move data solutions safely between environments
- Identify opportunities to standardize, automate, and simplify recurring data work to reduce manual data preparation and reporting effort
- Support production data operations and participate in after-hours troubleshooting or scheduled implementation activities when needed
Requirements
- Strong working knowledge of Databricks lakehouse concepts, including notebooks, clusters or serverless compute, jobs/workflows, SQL Warehouses, and Delta Lake
- Strong SQL development skills including complex joins, common table expressions, window functions, query optimization, data reconciliation, and relational data modeling
- Experience using Python and/or PySpark for ingestion, transformation, validation, and automation
- Knowledge of Parquet file structure and behavior, including compression, schema evolution, partitioning, and small-file performance considerations
- Understanding of dimensional modeling, fact and dimension tables, star schemas, slowly changing dimensions, and semantic model design
- Working knowledge of Power BI Report Server, Power BI Desktop, Power Query, DAX, dataset refresh, gateways or connectivity, security, and report performance
- Understanding of ETL and ELT patterns including batch processing, incremental loading, change data capture, orchestration, dependency management, and restartable pipeline design
- Knowledge of data quality, governance, metadata, lineage, master/reference data, retention, privacy, and role-based access principles
- Ability to trace data from source through transformation to final report and explain discrepancies in clear, practical terms
- Strong troubleshooting, analytical, documentation, organization, and time-management skills
- Ability to manage competing priorities, communicate risks or blockers, and drive assigned work through completion
- Ability to explain technical data concepts and findings to technical and non-technical audiences
- Self-motivated approach with judgment to ask questions, validate assumptions, and escalate concerns when necessary
- Associate’s or Bachelor’s degree in Information Technology, Computer Science, Data Engineering, Analytics, or a related field, or at least 4 years of equivalent experience in lieu of the degree requirement
- At least 3 years of experience in data engineering, business intelligence, data integration, database development, or a comparable role
- Demonstrated hands-on experience developing SQL-based data solutions and supporting production data pipelines
Technologies
- Databricks
- SQL
- Python
- PySpark
- Notebooks
- Workflows
- Parquet
- Delta Lake
- Power BI Report Server
- Power BI Desktop
- Power Query
- DAX
- SQL Warehouses
- Microsoft SQL Server
- ETL
- ELT
- Power BI
- Amazon APIs
- Cloud platforms
- APIs
- Microsoft Fabric
- Azure Data Engineer
Location and Work Setup
- Nashville, TN (onsite)
- Work is primarily performed in an office or remote-office environment and requires extended use of a computer
- Must be willing and able to travel to clinic or business locations when necessary