EngineerJobs.io
← Back to all jobs
Bright Vision Technologies

Streaming Data Engineer

Bright Vision Technologies
Remote Remote $78k - $105k/yr Full time Posted 6d ago
Big Data Cloud Streaming Data Data Engineer Data Engineering Data Integration Data Pipeline Data Pipelines Data Platform Data Processing Data Stream Data Stream Processing Data Streaming Event Driven Architecture Event Streaming Kafka Kafka Connect Kafka Streams Stream Processing Streaming Data
Apply Now

Job Description

Bright Vision Technologies is hiring a Streaming Data Engineer for a 100% remote role based in the U.S. In this position, you will architect, deploy, and operate large-scale Apache Kafka and Confluent Platform environments that support mission-critical, event-driven workloads.

You will own the Kafka platform end-to-end, from capacity planning and configuration through security, automation, observability, and developer enablement, partnering with engineering teams to turn ambiguous requirements into well-engineered streaming solutions.

Role Overview

  • Architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments for mission-critical event-driven workloads.
  • Own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.
  • Partner with application teams to deliver a reliable, performant, and developer-friendly streaming platform.
  • Work closely with cross-functional partners including product, design, engineering, operations, and business stakeholders to translate ambiguous requirements into solutions.
  • Raise the bar through code review, design review, and mentorship of more junior engineers.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
  • 5+ years of experience operating Apache Kafka or Confluent Platform in production.
  • Deep, hands-on knowledge of Kafka internals: partitions, replication, ISRs, and consumer groups.
  • Strong experience with Kafka security: SASL, mTLS, ACLs, and RBAC.
  • Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
  • Experience implementing HA/DR strategies for Kafka.
  • Strong scripting skills in Python, Bash, or Go.
  • Hands-on experience with infrastructure-as-code using Terraform and Ansible.
  • Working knowledge of observability tooling for Kafka.
  • Excellent troubleshooting, communication, and documentation skills.

Technologies

  • Apache Kafka, Confluent Platform
  • Kafka Connect, Schema Registry
  • Kafka Streams, ksqlDB
  • SASL, mTLS, ACLs, RBAC
  • Python, Bash, Go
  • Terraform, Ansible
  • Kafka (observability tooling)

Preferred Qualifications

  • Confluent Certified Administrator or Developer credentials.
  • Experience operating Kafka on Kubernetes using Strimzi or Confluent Operator.
  • Exposure to managed Kafka services such as AWS MSK or Azure Event Hubs Kafka API.
  • Familiarity with stream processing frameworks including Flink or Spark Streaming.
  • Experience with data governance and lineage for streaming data.

Compensation and Location

  • Location: Remote (remote)
  • Salary: USD 78,000 - 105,000 per year

Visa Sponsorship

  • U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply.
  • We are unable to sponsor new H-1B visa petitions for this position.

How to Apply

For immediate consideration, send your resume to [email protected].

Similar Jobs