Data Engineer
Job Description
OD Talent Partners is seeking an experienced Data Engineer to build scalable pipelines that support AI and machine learning dataset preparation.
Responsibilities
- Design, develop, and maintain scalable data pipelines for sensor and multimodal datasets
- Process, synchronise, transform, and validate camera, LiDAR, GNSS, IMU, and telemetry data
- Build automated workflows to prepare high-quality datasets for AI training and annotation
- Implement data quality checks, metadata management, and dataset lineage
- Support dataset versioning to ensure reproducibility across iterations
- Optimise cloud-based pipelines for performance, reliability, and cost efficiency
- Collaborate with AI, data science, annotation, and platform engineering teams
Requirements
- Hands-on programming skills in Python and SQL
- Experience processing unstructured and multimodal data, including video, images, LiDAR, GNSS, IMU, and telemetry
- Proven experience building ETL/ELT pipelines and preparing datasets for AI/ML applications
- Experience with distributed data processing frameworks
- Strong knowledge of cloud platforms, object storage, data lakes/lakehouses, and workflow orchestration
- Understanding of data quality, metadata, lineage, schema management, and dataset versioning
- Strong problem-solving, communication, and collaboration skills
Technologies
- Python
- SQL
- ETL
- ELT
Benefits
- Discretionary annual incentives
- Medical, dental and vision coverage
- 401(k)
- Paid time off
- Parental leave
- Certification and training reimbursement
- Additional employee benefits
Salary & Work Location
- Salary: $100,000 - $130,000 per year (USD)
- Work location: Hybrid remote in Dallas, NC 28034
Similar Jobs
C