Data Engineer III

Responsibilities

• Design, build, and deploy reliable data solutions aligned with business requirements.
• Maintain artifacts such as data flow diagrams, end user process maps, and technical design documents.
• Identify trends in data sets and create algorithms to enhance data usability for IEHP.
• Architect and sustain optimal data pipeline architecture that adheres to security standards.
• Lead internal process improvements by automating manual tasks, optimizing data delivery, and reconfiguring infrastructure for scalability.
• Develop best practices for database design and development activities.
• Create complex functions, scripts, and services to support the Data Services team.
• Ensure all data solutions meet company requirements and performance targets.
• Operate with minimal supervision and exercise independent judgment.
• Perform code reviews and mentor junior engineers (Level I and II).
• Serve as a subject matter expert for key business initiatives and projects.
• Recommend improvements to existing Data Services processes as needed.
• Provide detailed analyses of data issues, data mapping, and automation plans to improve data quality.
• Evaluate and integrate new technologies with existing applications to enhance design and functionality.
• Maintain proficiency in REST web services, C#.NET, TSQL, XML, JSON, and related languages/frameworks.
• Develop and automate data ingestion from multiple sources, including external APIs.
• Program and modify code in Java, JSON, Python, and Spark to support data warehouse solutions.
• Design and deploy enterprise-scale cloud infrastructure solutions.
• Research and select technical approaches to solve complex development and integration challenges.
• Collaborate with Data and Engineering teams to deliver top-tier Azure implementations.
• Communicate progress and plans clearly with management, colleagues, and domain units.

Requirements

• Eight (8) years of experience provisioning, configuring, and developing solutions in Azure Data Lake, Azure Data Factory, Azure SQL Data Warehouse, Azure Synapse, and Cosmos DB.
• Eight (8) years implementing software development methodologies.
• Eight (8) years working with relational databases.
• Experience performing root cause analysis on internal and external data and processes.
• Experience using source control and CI/CD tools such as Azure DevOps and GitLab/GitHub.
• Experience transforming requirements into design concepts and ERDs using Visio or similar tools.
• Of the total eight, a minimum of five (5) years hands-on experience with cloud orchestration, automation tools, and CI/CD pipeline creation.
• Bachelor’s degree in Computer Science, Statistics, Mathematics, or Engineering from an accredited institution.
• DevOps experience and proficiency in Python, Java, or JSON; HL7/FHIR is a plus.
• Familiarity with applicable data privacy practices and laws.
• Knowledge of common SDLC models (Waterfall, Agile Scrum and Kanban) and DevOps practices.
• Experience with NoSQL databases (eg, MongoDB) and relational databases such as MS SQL Server.
• Fluency in at least one scripting or programming language, with Python highlighted.
• Experience with message queuing, stream processing, and scalable big data stores.

Technologies

• REST web services
• C#.NET
• TSQL
• XML
• JSON
• Java
• Python
• Spark
• Visio
• MongoDB
• MS SQL Server
• NoSQL technologies
• HL7/FHIR
• Azure cloud services (Data Lake, Data Factory, SQL Data Warehouse, Synapse, Cosmos DB)
• GitLab, GitHub, Azure DevOps

Compensation

• Annual salary range: USD 118,602 to 157,144

Benefits

• Competitive salary
• Hybrid schedule
• CalPERS retirement
• State of the art fitness center on-site
• Medical insurance with dental and vision
• Life, short-term, and long-term disability options
• Career advancement opportunities and professional development
• Wellness programs that promote work-life balance
• Flexible Spending Account – Health Care/Childcare
• 457(b) option with a contribution match
• Paid life insurance for employees
• Pet care insurance

Work Model and Location

• Hybrid work arrangement in California, with Monday and Friday remote and onsite work required Tuesday through Thursday