Senior Data Engineer

PGIM seeks a Senior Data Engineer to design, build, and maintain scalable data and AI solutions on modern cloud platforms. The role collaborates with senior engineers and stakeholders to deliver data pipelines, analytics, and AI capabilities. Based in Newark, New Jersey, this position requires a hybrid work arrangement with three on-site days per week.

Responsibilities

• Build and maintain scalable data pipelines (ETL/ELT)
• Develop solutions using Microsoft Fabric, Azure Data Factory, or similar
• Implement data quality checks, transformations, and data modeling
• Work with large-scale datasets using PySpark and SQL
• Deploy and integrate machine learning models into pipelines
• Develop AI powered solutions including semantic search, embeddings, and RAG
• Build and expose data and AI services via APIs
• Contribute to CI/CD pipelines using GitHub Actions or Azure DevOps
• Implement best practices for data security, governance, and access
• Monitor and troubleshoot pipelines and AI systems
• Collaborate with analysts, scientists, and stakeholders
• Contribute to documentation and reusable components

Requirements

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field
• 3–6 years of experience in data and AI engineering
• Strong Python and SQL skills
• Experience with data pipeline tools such as Azure Data Factory, Fabric, AWS Glue, or similar
• Experience with Spark or PySpark
• Familiarity with data lakes and data warehouses
• Experience deploying machine learning models
• Basic understanding of MLOps
• Exposure to Generative AI concepts such as embeddings, RAG, and LLM APIs
• Experience with REST APIs and microservices
• Familiarity with CI/CD and Git
• Understanding of data governance and security
• Strong problem-solving and communication skills

Technologies

• Microsoft Fabric
• Azure Data Factory
• AWS Glue
• PySpark
• Spark
• Python
• SQL
• REST APIs
• GitHub Actions
• Azure DevOps
• LLM APIs

Benefits

• Market-competitive base salary with annual bonus potential
• Medical, dental, vision, life and disability insurance; PTO and parental/military leave
• 401(k) with company match (up to 4%)
• Company-funded pension plan
• Wellness programs with up to $1,600/year reimbursement for wellbeing needs
• Work/Life resources
• Education benefit for degree/certificate programs
• Employee Stock Purchase Plan (ESPP) with 85% purchase price after one year

Note

The annual base salary range for this role is $115,000 to $155,000. Final compensation within this range may vary based on geographic location, candidate experience, and skills, in accordance with state disclosure requirements.