Senior Data Engineer
Job Description
Persistent is seeking a Senior Data Engineer to design, build, and operate enterprise-scale real-time data platforms and streaming solutions. The role centers on resilient, low-latency, event-driven architectures and hands-on ownership of production operations, with a focus on correctness, reliability, and observability for business-critical workloads in a hybrid setting in New Jersey.
Responsibilities
- Bring deep experience designing, building, and operating real-time data platforms, streaming architectures, and distributed systems across complex enterprise environments.
- Apply at least 8 years of hands-on production experience running real-time streaming solutions at scale, with accountability for reliability, performance, observability, recovery, and operational stability.
- Use strong software engineering skills with Java to deliver production-grade code and lead technical implementations for critical systems.
- Demonstrate technical credibility across streaming and event-driven concepts, including partitioning, ordering, stateful processing, delivery semantics, replay, fault tolerance, and platform resilience.
- Lead engineering teams through mentoring and delivery leadership, maintaining high standards for design, coding, testing, and operational support.
- Work with modern streaming and data technologies including Kafka, Pulsar, Kinesis, Flink, Spark Structured Streaming (or equivalents), selecting appropriate patterns for each problem.
- Ensure production data platforms meet control, governance, and risk management expectations, especially where resilience, auditability, and data correctness are required.
- Own the architecture, design, development, and operational stewardship of real-time streaming and data platform capabilities, staying hands-on in key technical decisions and implementation.
- Write, review, and guide high-quality production code for critical platform components, emphasizing maintainability, resilience, and performance.
- Develop teams by providing technical direction and coaching, fostering accountability, ownership, and continuous improvement.
- Own the design and production operation of resilient, low-latency streaming solutions processing critical financial events with strong guarantees for correctness, recoverability, observability, scalability, and control.
- Run streaming platforms at scale, supporting production health, capacity, reliability, incident response, recovery, and continuous service improvement.
- Collaborate with business, product, architecture, and control stakeholders to shape roadmaps, solve complex engineering problems, and align delivery with business and regulatory requirements.
- Drive modernization across streaming, event processing, and data movement, balancing hands-on contribution with leadership across delivery priorities and dependencies.
- Establish strong engineering disciplines across testing, code review, release management, observability, incident response, capacity planning, and production readiness for real-time workloads.
Requirements
- 8+ years of experience designing, building, and operating enterprise-scale real-time data platforms and streaming solutions.
- Deep expertise in Java, Spring Boot, Kafka, and distributed event-driven architectures.
- At least 8 years of hands-on experience running real-time streaming solutions in production at scale, accountable for reliability, performance, observability, recovery, and operational stability.
- Strong software engineering capability in Java, including production-grade coding and leadership in implementation for business-critical systems.
- Technical credibility in streaming and event-driven systems, including partitioning, ordering, stateful processing, delivery semantics, replay, fault tolerance, and platform resilience.
- Proven experience leading engineering teams, mentoring developers, and driving delivery while maintaining high standards across design, coding, testing, and operational support.
- Experience with Kafka, Pulsar, Kinesis, Flink, Spark Structured Streaming, or equivalent platforms, with the judgment to select the right patterns.
- Strong understanding of control, governance, and risk management expectations for production data platforms, particularly where resilience, auditability, and data correctness are business critical.
Technologies
- Java
- Spring Boot
- Kafka
- Pulsar
- Kinesis
- Flink
- Spark Structured Streaming
Benefits
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment
- Support for hybrid work and flexible hours to fit diverse lifestyles
- Accessibility-friendly office environment with ergonomic setups and assistive technologies to support employees with physical disabilities
- If you are a person with disabilities and have specific requirements, inform the team during the application process or at any time during employment
Location: New Jersey (hybrid)
Minimum Experience: 8 years
Similar Jobs
S