Sunbelt Rentals, Inc. is seeking a Senior Data Engineer to build and run end-to-end IoT data pipelines that turn high-frequency device telemetry into reliable analytics-ready data in Databricks. This onsite role in Fort Mill, SC combines hands-on engineering with platform stewardship, including streaming ingestion, Delta Lake management, and production troubleshooting. You’ll also mentor other engineers and help shape the data platform as new tools and technologies emerge.
What you’ll do
- Design, build, and maintain IoT data pipelines from edge devices into Databricks using the Bronze/Silver/Gold (medallion) architecture
- Lead development and optimization of streaming ingestion pipelines using Apache Kafka and Databricks Structured Streaming
- Define and enforce data engineering best practices, including pipeline design patterns, data quality frameworks, and schema governance
- Architect and manage Delta Lake tables, including partitioning strategies, Z-ordering, and vacuuming to improve performance and cost efficiency
- Collaborate with infrastructure and cloud teams to configure and manage Databricks clusters, Unity Catalog, and Delta Live Tables
- Mentor junior and mid-level data engineers through code reviews, pair programming, and technical guidance
- Partner with data scientists and analysts to ensure processed data supports downstream analytical and ML needs
- Troubleshoot production pipeline failures and drive root-cause analysis and resolution
- Evaluate and introduce new tools and technologies to continuously improve the data platform
What you bring
- 5+ years of data engineering experience, with at least 2 years working extensively with Databricks
- Strong proficiency in Python and SQL, including production-grade Spark development
- Hands-on experience building and managing Kafka-based streaming pipelines
- Deep familiarity with Delta Lake, Delta Live Tables, and the Databricks ecosystem (Unity Catalog, Workflows, MLflow)
- Experience with IoT data patterns such as high-frequency telemetry ingestion, device state management, and time-series data
- Solid understanding of cloud infrastructure (with Azure preferred) and infrastructure-as-code concepts
- Strong communication skills to lead technical discussions and translate requirements into architecture
Tools you’ll work with
Databricks, Apache Kafka, Databricks Structured Streaming, Delta Lake, Delta Live Tables, Unity Catalog, Workflows, MLflow, Python, SQL, Spark, Azure, Infrastructure-as-code, Bronze/Silver/Gold, Z-ordering, vacuuming, IoT, ML.
Benefits and time off
- Health, Dental and Vision plans
- 401(k) Match
- Volunteer time off
- Short-term and long-term disability
- Accident, Life and Travel insurance, plus flexible spending
- Tuition Reimbursement Options
- Employee Assistance Program (EAP)
- Length of Service Awards
Paid time off includes: 12-25 vacation days (depending on years of service), 5 sick days, 6 holidays, 2 half day holidays, 2 floating holidays, 1 inclusion day, and 1 volunteer day.
You will become eligible for benefits on the first of the month following 30 days from your start date.
Preferred qualifications
- Experience with Geotab or similar fleet telematics platforms
- Databricks Certified Data Engineer Associate or Professional certification
- Familiarity with Azure Key Vault, Event Hubs, or Azure Data Factory
- Experience with dbt for data transformation
- Bachelor’s degree in computer science, Information Technology, Data Engineering, or equivalent experience
Compensation and eligibility
Salary range: USD 130,315 - 179,183 per year.
Base pay range: $130,315.00 - 179,183.40.
Physical demands and safety
- Must be able to bend, squat, crouch and/or reach and lift up to 25 pounds or more, as required by the job
- Some Sunbelt jobs may require driving for long periods, loading and unloading heavy equipment, working in extreme weather conditions (including rain, wind, excessive temperatures), and/or night and weekend work
- All duties must be performed according to Sunbelt safety policies and guidelines
- Reasonable accommodations may be made to comply with ADA/ADAAA
