EngineerJobs.io
← Back to all jobs
Vaco by Highspring

Data Engineer - Databricks

Vaco by Highspring
Tampa, FL $100k+/yr Full time Posted 2d ago
Big Data Bigdata Data Analysis Data Analytics Data Architecture Data Engineer Data Integration Data Pipeline Data Pipelines Data Platform Data Processing Database Databases Databricks Kafka MongoDB Nosql Databases PostgreSQL Spark SQL
Apply Now

Job Description

This onsite Data Engineer role in Tampa, FL offers USD 100,000 per year and centers on Databricks to modernize BI capabilities, design data pipelines, deploy machine learning solutions, and operationalize analytics to inform decisions across the organization.

Responsibilities

  • Develop and manage end-to-end data pipelines and system integrations
  • Architect, design, and build data pipelines to support scalable analytics
  • Deploy machine learning solutions and monitor their performance in production
  • Operationalize analytics to enable data driven decision making across teams

Requirements

  • Databricks expertise
  • Advanced SQL optimization and complex query design
  • Kafka streaming applications and connector development
  • Databricks workflow development with medallion architecture
  • Data governance implementation and compliance
  • Performance tuning for large-scale data processing
  • Data security and privacy best practices
  • Apache NiFi pipeline development for invoice and PO processing
  • Integration with purpose-built data stores (Druid, MongoDB, OpenSearch, Postgres)
  • Build and maintain end-to-end ML pipelines for training, deployment, and monitoring of models
  • Design and optimize data architectures for large-scale ML workloads
  • Explore and implement LLM-based solutions, RAG architectures, and generative AI for business use cases
  • Cross-functional collaboration with product and engineering teams
  • Technical mentoring for junior data engineers
  • Analytical thinking for complex data problems
  • Stakeholder communication for data requirements
  • Process improvement and efficiency focus
  • Direct communication with data platform vendors
  • Evaluates vendor tools for specific data use cases
  • Provides technical feedback on vendor product roadmaps
  • Coordinates with vendors for data integration projects
  • 5+ years in data engineering
  • 2+ years applying ML in production
  • Bachelor's or Master's in Computer Science, Data Engineering, Statistics, or related field

Technologies

  • Databricks
  • SQL
  • Kafka
  • Apache NiFi
  • Medallion architecture
  • Druid
  • MongoDB
  • OpenSearch
  • Postgres

Benefits

  • Discretionary bonuses
  • Medical benefits
  • Dental benefits
  • Vision benefits
  • 401(k) retirement plan

Similar Jobs