Data Engineer (On-Premise and Hybrid)
Aws Data Engineering
Big Data
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Flink
Informatica
Information Technology (IT)
Integration
Software Development
SQL
Job Description
JetHead Development Inc. is hiring a Data Engineer to design, build, and maintain data pipelines, streaming applications, and supporting cloud infrastructure. This hybrid role is based in Carlsbad, CA, with on-site collaboration required to support analytics and operational decision-making.
Responsibilities
- Develop and maintain streaming and batch data pipelines using Python, Apache Flink, and Kafka.
- Integrate data sources through Kafka Connect and AWS Managed Streaming for Apache Kafka (Amazon MSK).
- Build and maintain datasets with Apache Iceberg, and enable SQL access through Amazon Athena.
- Implement data validation, schema evolution, and error handling to improve pipeline reliability as upstream data changes.
- Package and deploy applications using Docker, Kubernetes, and AWS EKS.
- Support repeatable deployments with Helm, Terraform, and GitHub Actions.
- Monitor pipeline health, performance, and failures using Prometheus and Grafana.
- Work with analysts and customers to understand requirements, troubleshoot issues, and document solutions.
Requirements
- Practical Python experience, including work with structured data.
- Experience building data pipelines or applications that ingest, transform, and store data.
- Familiarity with containerization and continuous integration and delivery practices.
- Understanding of Kafka or comparable event-streaming concepts.
- Awareness of data schemas, data quality checks, and managing changes to data formats.
- Foundational knowledge of cloud infrastructure, including compute, storage, networking, and access controls.
- Working knowledge of SQL, Git, and collaborative development.
- Strong problem-solving, documentation, and interpersonal skills.
- Ability to participate in a hybrid schedule with on-site work in Carlsbad, CA.
- Authorization to work in the United States without employer sponsorship.
Technology Stack
- Python, Apache Flink, Kafka, Kafka Connect
- AWS Managed Streaming for Apache Kafka (Amazon MSK), Apache Iceberg, Amazon Athena
- Docker, Kubernetes, AWS EKS, Helm, Terraform, GitHub Actions
- Prometheus, Grafana, SQL, Git
Preferred Qualifications
- Hands-on experience with Apache Flink, Kafka Connect, Apache Iceberg, Athena, or AWS Batch.
- Experience with Kubernetes, Helm, Terraform, and GitHub Actions.
- Familiarity with Prometheus and Grafana.
- Experience with specification-driven development, including tools such as OpenSpec.
- Familiarity with Model Context Protocol (MCP) and preparing documented, governed datasets for access through MCP tools.
- Knowledge of network or satellite systems.
Compensation and Job Details
Job Type: Full-time
Salary: USD 90,000 - 190,000 per year
Work Location: Hybrid remote in Carlsbad, CA 92008
Benefits
- 401(k) retirement plan with employer matching
- Medical, dental, and vision coverage
- Health savings account
- Life insurance
- Paid time off
- 401(k)
- 401(k) matching
- Dental insurance
- Health insurance
- Vision insurance
Relocation and Commuting Requirements
- Ability to commute: Carlsbad, CA 92008 (Required)
- Ability to relocate: Carlsbad, CA 92008: Relocate before starting work (Required)