Data Engineer – Physical AI Platform

As a Data Engineer on Caterpillar’s Physical AI Platform team, you will design, build, and maintain scalable data pipelines and cloud-based systems. The role emphasizes performance, reliability, and data quality while supporting both real-time and batch processing across distributed environments.

Responsibilities

• Design, build, and optimize data pipelines and microservices for real-time and batch processing using Python
• Develop cloud-based data ingestion solutions using AWS services such as Kinesis, S3, DynamoDB, and EventBridge
• Build and maintain data integration workflows for source data pipelines aligned to CI Autonomy
• Translate business requirements into dependable data workflows, mappings, and system designs
• Implement automated testing and validation to help ensure data integrity across distributed systems
• Monitor and troubleshoot pipelines using tools such as CloudWatch to maintain reliability

Requirements

• Ability to analyze issues in distributed data systems and deliver scalable solutions
• Ability to document data flows, mappings, and system behavior clearly for cross-team use
• Experience building backend systems and pipelines using Python, Java, and modern frameworks
• Experience delivering solutions in an agile environment
• Experience integrating APIs, streaming platforms, and databases
• Ability to design scalable, event-driven data systems
• Strong understanding of AWS services and data engineering tools
• Experience implementing testing strategies to ensure data quality and system reliability

Technology Stack

• Python, Java
• AWS, including Kinesis, S3, DynamoDB, EventBridge
• Event-driven data systems
• CloudWatch
• SQL, CI/CD tools
• Azure DevOps, Jira, Jenkins
• CI Autonomy
• OAuth 2.0, APIs, microservices
• Relational and noSQL databases
• Streaming platforms
• Distributed systems

Education and Experience

• Minimum experience: 2 years
• Education: Bachelor’s degree in Computer Science, Computer Engineering, or a related field

Top Candidate Profile

• Bachelor’s degree in Computer Science, Computer Engineering, or related field
• 2+ years development experience on modern, large-scale, complex data platforms
• 3+ years developing and deploying Java or Python solutions to a production environment
• Experience building high-throughput, scalable data pipelines
• Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.)
• Proficiency in SQL, including data quality and validation practices
• Proficiency deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc.
• Experience developing microservices that support real-time data ingestion
• Experience developing software applications using relational and noSQL databases
• Ability to ensure data integrity across distributed and streaming systems
• Experience with API development and secure integrations (OAuth 2.0)
• Proven experience with monitoring, testing, and automation in large-scale data environments

Benefits

• Medical, dental, and vision benefits
• Paid time off plan (Vacation, Holidays, Volunteer, etc.)
• 401(k) savings plans
• Health Savings Account (HSA)
• Flexible Spending Accounts (FSAs)
• Health Lifestyle Programs
• Employee Assistance Program
• Voluntary Benefits and Employee Discounts
• Career Development
• Incentive bonus
• Disability benefits
• Life Insurance
• Parental leave
• Adoption benefits
• Tuition Reimbursement

Location, Work Model, and Eligibility

• Location: Irving, TX (onsite)
• Work arrangement: Full-time at the Irving, TX office (Dallas)
• Domestic relocation assistance is available
• Visa sponsorship is available

Pay Range and Posting Notes

• Salary range: USD 97,530 - 158,480 per yearly
• Any offer of employment is conditioned upon the successful completion of a drug screen
• Caterpillar is an Equal Opportunity Employer, including Veterans and Individuals with Disabilities; qualified applicants of any age are encouraged to apply