Associate - Data Engineer
Amazon Web Services
AWS
Aws Data Engineering
Aws Glue
Big Data
Bigdata
Cloud
Cloud Computing
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Build Tool
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Management
Data Modeling
Data Operations
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Transforms
Data Warehouse
Database
Databases
Databricks
ETL
Event Driven Architecture
Informatica
Integration
IT Services
Kafka
Pyspark
Spark
SQL
Streaming Data
Job Description
New York Life is seeking an Associate Data Engineer to join the Data Engineering team within Tech Data AI Ventures. In this hybrid role based in Lebanon, NJ, you will help deliver clean, well-structured, and reliable enterprise data that supports analytics and AI solutions across the organization.
You will build and evolve scalable data pipelines and data models using modern data engineering tools, while partnering with data scientists, technology teams, business stakeholders, and data stewards to ensure data quality and alignment with governance standards.
What you will do
- Develop and maintain scalable data models and pipelines using dbt, PySpark, AWS Glue, Databricks, and streaming technologies to deliver clean and reliable data for analytics, data science, and AI use cases.
- Use software engineering best practices for data development, including version control, testing, integration, code reviews, and pull request approvals to support quality and consistency.
- Partner with data scientists, business stakeholders, and data stewards to source strategic enterprise data, address data quality and availability needs, and align solutions with data governance standards.
- Convert business and technical requirements into actionable development plans and Jira stories, define milestones, and manage work through delivery.
- Collaborate with Technology teams on data strategy, tooling, system integrations, and deployment processes, communicating technical concepts and recommendations to diverse audiences.
Qualifications
- 2–5+ years of relevant data engineering or related experience, including hands-on development and maintenance of dbt data models and transformation pipelines.
- Proficiency with AWS Glue, including ETL development, job orchestration, and catalog integration; experience using PySpark for data processing.
- Strong working knowledge of Databricks, including SQL, notebooks, and distributed data processing.
- Experience with Kafka or comparable streaming technologies for real-time data ingestion and processing.
- Strong analytical and problem-solving skills to troubleshoot complex data and engineering issues and implement practical solutions.
- Effective communication and collaboration skills across technical and business teams, including the ability to explain technical concepts to varied audiences.
Technical tools and platforms
- dbt, PySpark, AWS Glue, Databricks
- Kafka (streaming technologies), SQL, notebooks
- Jira
Preferred skills
- Experience with Google Cloud Platform (GCP) or related cloud data technologies.
- Experience working in insurance, financial services, or another regulated industry.
- Experience partnering with data science teams to support analytics, machine learning, or AI use cases.
Location and work model
- Location: Lebanon, New Jersey, United States
- Work model: Hybrid (3 days per week)
Compensation and eligibility
- Salary range: USD 81,000 - 115,500 per year
- Overtime eligible: Exempt
- Discretionary bonus: Eligible (Yes)
- Sales bonus: Not eligible
Benefits
- Leave programs
- Adoption assistance
- Student loan repayment programs
- Annual discretionary bonus
- In addition to base salary, eligibility to participate in an incentive program
Department: Tech Data AI Ventures
Job function: Tech Data AI Ventures
Job level: LEVELPF2
Job requisition ID: 95121
Similar Jobs
