EngineerJobs.io
← Back to all jobs

Job Description

Persistent is seeking a Senior Data Engineer to design, build, and operate enterprise-scale real-time data platforms and streaming solutions. The role centers on resilient, low-latency, event-driven architectures and hands-on ownership of production operations, with a focus on correctness, reliability, and observability for business-critical workloads in a hybrid setting in New Jersey.

Responsibilities

  • Bring deep experience designing, building, and operating real-time data platforms, streaming architectures, and distributed systems across complex enterprise environments.
  • Apply at least 8 years of hands-on production experience running real-time streaming solutions at scale, with accountability for reliability, performance, observability, recovery, and operational stability.
  • Use strong software engineering skills with Java to deliver production-grade code and lead technical implementations for critical systems.
  • Demonstrate technical credibility across streaming and event-driven concepts, including partitioning, ordering, stateful processing, delivery semantics, replay, fault tolerance, and platform resilience.
  • Lead engineering teams through mentoring and delivery leadership, maintaining high standards for design, coding, testing, and operational support.
  • Work with modern streaming and data technologies including Kafka, Pulsar, Kinesis, Flink, Spark Structured Streaming (or equivalents), selecting appropriate patterns for each problem.
  • Ensure production data platforms meet control, governance, and risk management expectations, especially where resilience, auditability, and data correctness are required.
  • Own the architecture, design, development, and operational stewardship of real-time streaming and data platform capabilities, staying hands-on in key technical decisions and implementation.
  • Write, review, and guide high-quality production code for critical platform components, emphasizing maintainability, resilience, and performance.
  • Develop teams by providing technical direction and coaching, fostering accountability, ownership, and continuous improvement.
  • Own the design and production operation of resilient, low-latency streaming solutions processing critical financial events with strong guarantees for correctness, recoverability, observability, scalability, and control.
  • Run streaming platforms at scale, supporting production health, capacity, reliability, incident response, recovery, and continuous service improvement.
  • Collaborate with business, product, architecture, and control stakeholders to shape roadmaps, solve complex engineering problems, and align delivery with business and regulatory requirements.
  • Drive modernization across streaming, event processing, and data movement, balancing hands-on contribution with leadership across delivery priorities and dependencies.
  • Establish strong engineering disciplines across testing, code review, release management, observability, incident response, capacity planning, and production readiness for real-time workloads.

Requirements

  • 8+ years of experience designing, building, and operating enterprise-scale real-time data platforms and streaming solutions.
  • Deep expertise in Java, Spring Boot, Kafka, and distributed event-driven architectures.
  • At least 8 years of hands-on experience running real-time streaming solutions in production at scale, accountable for reliability, performance, observability, recovery, and operational stability.
  • Strong software engineering capability in Java, including production-grade coding and leadership in implementation for business-critical systems.
  • Technical credibility in streaming and event-driven systems, including partitioning, ordering, stateful processing, delivery semantics, replay, fault tolerance, and platform resilience.
  • Proven experience leading engineering teams, mentoring developers, and driving delivery while maintaining high standards across design, coding, testing, and operational support.
  • Experience with Kafka, Pulsar, Kinesis, Flink, Spark Structured Streaming, or equivalent platforms, with the judgment to select the right patterns.
  • Strong understanding of control, governance, and risk management expectations for production data platforms, particularly where resilience, auditability, and data correctness are business critical.

Technologies

  • Java
  • Spring Boot
  • Kafka
  • Pulsar
  • Kinesis
  • Flink
  • Spark Structured Streaming

Benefits

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment

  • Support for hybrid work and flexible hours to fit diverse lifestyles
  • Accessibility-friendly office environment with ergonomic setups and assistive technologies to support employees with physical disabilities
  • If you are a person with disabilities and have specific requirements, inform the team during the application process or at any time during employment

Location: New Jersey (hybrid)
Minimum Experience: 8 years

Similar Jobs