Senior Data Engineer
Python
Senior
Artificial Intelligence
Cloud Data Engineering
Data
Data Analysis
Data Analytics
Data Engineer
Data Engineering
Data Integration
Data Pipeline
Data Platform
Data Processing
Database
Databases
ETL
Informatica
Information Technology (IT)
Programming
Programming Language
Programming Languages
Reporting and Analytics
SQL
Job Description
Join Caterpillar’s Data Engineering team to build Python-based data pipelines and deliver business data objects that power applications.
Responsibilities
- Develop Python data pipelines that create business data objects used by applications
- Work across functional lines on new program development initiatives
- Handle complex programming, project management, and development work with minimal supervision
- Identify, analyze, and resolve complex application and technical problems
- Interpret design requirements to support engineering implementation
- Build and deploy CI/CD pipelines
- Implement source-to-target mappings as pipeline code
- Own unit and integration testing for delivered solutions
- Maintain team software quality through strong development practices and habits
- Identify and encourage growth and continuous improvement within the team
- Perform other duties as assigned by Caterpillar management from time to time
Requirements
- Strong expertise in software development tools and activities, including delivering software products aligned to requirements
- Strong expertise in software development lifecycle and structured delivery methodology for new or enhanced products
- Strong expertise in software product design, including translating market requirements into design
- Strong expertise in technical design, configuration, and integration of software product components
- Strong expertise in software product testing, including designing, planning, and executing testing strategies and tactics
- Experience designing and developing software applications in Python
- Experience using Git version control with medium to large teams
- Experience deploying software via CI/CD tools such as Jenkins, GitHub Actions, Azure DevOps
- Experience with AWS components: Lambda, Kinesis, EventBridge, CloudWatch, CloudFormation, Dynamo, Fargate, S3, SageMaker, IAM, RDS
- Experience working with Snowflake
- Hands-on experience with GenAI developer tools
- Experience with tools such as GitHub Copilot or Claude Code (or similar AI coding assistants)
Technologies
- Python
- CI/CD
- Jenkins
- GitHub Actions
- Azure DevOps
- Git
- AWS Lambda, Kinesis, EventBridge, CloudWatch, CloudFormation, Dynamo, Fargate, S3, SageMaker, IAM, RDS
- Snowflake
- GenAI developer tools
- GitHub Copilot
- Claude Code
- Unit testing, Integration testing
Location and Work Model
- Chicago, IL (onsite)
- This position requires being in Chicago, IL, Peoria, IL, or Dallas, TX
- Onsite required five days a week
Compensation
- USD 112,710 - 183,140 per year
Benefits
- Medical, dental, and vision benefits*
- Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
- 401(k) savings plans*
- Health Savings Account (HSA)*
- Flexible Spending Accounts (FSAs)*
- Health Lifestyle Programs*
- Employee Assistance Program*
- Voluntary Benefits and Employee Discounts*
- Career Development*
- Incentive bonus
- Disability benefits
- Life Insurance
- Parental leave
- Adoption benefits
- Tuition Reimbursement
Additional Details
- Domestic relocation assistance is not available
- Visa sponsorship is not available
- Employment is conditioned upon successful completion of a drug screen
Similar Jobs
