AWS/Kafka Data Engineer - Senior Software Engineer
Backend Developer
Aws Data Engineer
Aws Data Engineering
Big Data
Cloud Engineer
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Director
Data Integration
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Database
Databases
Event Driven Architecture
Kafka
Kafka Connect
Kafka Streams
SQL
Stream Processing
Streaming Data
Job Description
Design and deliver real-time and batch data platforms using AWS and Apache Kafka in a hybrid role supporting enterprise integrations.
Responsibilities
- Design, build, and deploy resilient real-time and batch data pipelines that integrate disparate ERP systems with downstream data lakes and platforms
- Use Apache Kafka, Kafka Connect, and stream processing engines (Kafka Streams or Apache Flink) to process and transform high-volume CDC and transactional data
- Develop microservices and integration layers with Java and Spring Boot to orchestrate complex data flows and enterprise APIs
- Package applications into Docker containers and support scalable deployments, service discovery, and container orchestration with Kubernetes
- Optimize data movement and processing across multi-database environments including PostgreSQL, MySQL, SQL Server, and Oracle
- Implement Infrastructure as Code with Terraform or AWS CloudFormation
- Build automated CI/CD deployment pipelines using GitHub Actions
- Set up monitoring, APM, log management, and alerting for pipeline health and transactional accuracy using tools such as DataDog, New Relic, or Splunk
Requirements
- 10+ years of software or data engineering experience
- Strong proficiency in AWS, Kafka, Java, Spring Boot, and Python
- Expertise with AWS Managed Kafka (data and integration)
- Experience designing and configuring AWS Managed Kafka
- Experience with PostgreSQL, MySQL, SQL Server, and Oracle
Technologies
- AWS
- Apache Kafka
- Kafka Connect
- Kafka Streams
- Apache Flink
- Java
- Spring Boot
- Docker
- Kubernetes
- PostgreSQL
- MySQL
- SQL Server
- Oracle
- Terraform
- AWS CloudFormation
- GitHub Actions
- DataDog
- New Relic
- Splunk
- AWS Managed Kafka
Compensation
- Base compensation range for the posted location: $89,400 - $166,398 per year
Benefits
- Paid time off based on employee grade (A-F), per policy: Vacation 12-25 days (depending on grade)
- Company paid holidays
- Personal Days
- Sick Leave
- Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
- Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
- Life and disability insurance
- Employee assistance programs
Location
- Atlanta, GA 30305 (hybrid)
- Hybrid role based across locations including Atlanta, Dallas, Chicago, Nashville, and New Jersey
Important Notice: In addition to base salary, this role may be eligible for additional compensation such as variable incentives, bonuses, or commissions, depending on the position and applicable laws.
Similar Jobs
