Associate Data Engineer
Big Data
Bigdata
Cloud Operations
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Engineer
Data Engineering
Data Integration
Data Operations
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
ETL
Informatica
Information Technology (IT)
Integration
Spark
SQL
Job Description
Crum & Forster is seeking an Associate Data Engineer to strengthen the S&S Data Science team’s External Data function. The role focuses on building and maintaining data pipelines that bring third-party information into underwriting, claims, and business intelligence workflows.
This is a hands-on position based in Morristown, NJ, with remote work available. The salary range is USD 71,600 to 105,000 per year, and the position calls for roughly 1+ year of experience.
What you’ll do
- Build and maintain batch and streaming ETL/ELT pipelines that deliver data into a cloud data warehouse.
- Develop, schedule, and monitor cloud data jobs, including diagnosing failures and tuning for cost and performance.
- Create idempotent load logic to support reprocessing and backfills without duplicating data.
- Integrate external data providers and REST APIs with authentication, error handling, and retries.
- Implement data quality checks, validation, and alerting to detect pipeline issues early.
- Manage and deploy pipelines using infrastructure-as-code and CI/CD.
- Support data migrations and service updates with minimal downtime.
- Produce clean, analytics-ready and model-ready datasets for data scientists and analysts.
Requirements
- 1-5+ years of professional experience in data engineering or a related software/data role.
- A Bachelor’s degree in Computer Science, Data Engineering, or a related technical field, or equivalent experience.
- Strong programming skills in Python and SQL.
- Familiarity with ETL/ELT concepts and experience building data pipelines.
- Experience with at least one major cloud platform, with AWS preferred.
- Familiarity with REST APIs and integrating external data sources.
- Strong attention to data quality and reliability.
- Ability to communicate clearly with both technical and business audiences.
Technologies
- Python, SQL
- AWS, including AWS Glue, AWS Lambda, and S3
- Snowflake
- Apache Spark
- Kafka, Kinesis
- ETL, ELT
- Infrastructure-as-code: CDK, Terraform, CloudFormation
- CloudWatch, CI/CD
- REST APIs
Benefits
- Competitive compensation package
- Generous 401K employer match
- Employee Stock Purchase plan with employer matching
- Generous Paid Time Off
- Excellent benefits that go beyond health, dental & vision
- Tuition reimbursement, industry-related certifications and professional training
- Dynamic, ambitious, fun and exciting work environment
- Matching donation program, volunteer opportunities, and an employee-driven corporate giving program
Nice to have
- Hands-on experience with AWS data services such as Glue, Lambda, and S3
- Experience loading and modeling data in a cloud data warehouse (for example Snowflake)
- Experience with distributed processing frameworks such as Apache Spark
- Experience with streaming technologies such as Kafka or Kinesis
- Experience with infrastructure-as-code (such as CDK, Terraform, or CloudFormation) and monitoring with CloudWatch
- Knowledge of geospatial analysis
- Familiarity with zero-downtime deployment patterns such as blue-green deployments
- Interest in insurance, underwriting, or claims