The Hanover Insurance Group offers a remote opportunity for a Data Engineer II within Personal Lines Operations. You will build and maintain Azure Data Factory pipelines and manage an on premise SQL Server data environment while balancing production support with new development. The role emphasizes data quality, monitoring, and release practices, with clear pathways for growth through hands on experiences, coaching, and formal learning programs.
Benefits
- Medical, dental, vision, life, and disability insurance
- 401K with a company match
- Tuition reimbursement
- PTO
- Company paid holidays
- Flexible work arrangements
- Cultural Awareness Day in support of IDE
- On site medical and wellness center (Worcester only)
Career Development
It is not just a job, it is a career. The Hanover supports you with on the job experiences, personalized coaching, and robust learning and development programs. Growth and advancement are encouraged at every level through structured development opportunities.
Responsibilities
- Provide production support and maintain daily health of scheduled Azure Data Factory pipelines
- Build new pipelines and enhance existing ones to improve resiliency, maintainability, and scalability
- Implement data validation controls, enhance monitoring and alerts, and help define SLAs for data freshness and availability
- Establish foundational SDLC practices for data engineering, including Git usage, Dev to Prod promotions, and formal release processes
- Coordinate cross team dependencies and design dependency aware orchestration and readiness checks
- Contribute to future state Azure data strategy, such as Data Lake/Blob Storage and notebooks, and support migration planning from on premise SQL Server to cloud databases
- Azure and Fabric Data Factory engineering
- Design and maintain curated SQL tables and views used for analytics and reporting; optimize for refresh performance and downstream usability
- Develop and maintain ADF pipelines (Copy activities and Data Flows) with consistent logging, error handling, retries, and notifications
- Implement parameterization and reusable components to reduce duplication and accelerate improvements
- Implement incremental load and backfill strategies appropriate to volume
- Monitor daily pipeline execution, triage incidents, and restore successful processing quickly
- Perform root cause analysis for failures and recurring issues; implement preventative controls and standardized patterns
- Create and maintain operational documentation and runbooks for critical pipelines and common support scenarios
- Build automated data quality and validation routines and reconciliation checks
- Collaborate with analysts and stakeholders to define business rules and quality thresholds for trusted datasets
- Document data definitions, transformations, and lineage to improve transparency
- Work with Operations Data Analysts, business stakeholders, and partner analysts to deliver datasets that enable robust Power BI models and analytics
- Coordinate with upstream teams to align dependency readiness signals and timelines, and implement orchestration controls
- Provide technical coaching and mentoring to less experienced team members
Key measures of success
- Pipelines meeting SLA and on time delivery
- Pipeline success rate with reduced manual intervention
- Time to detect and resolve ETL failures (MTTD/MTTR)
- Improvements in query performance, runtime, and cost efficiency
- Reduction in recurring data quality defects; checks pass
- Documentation coverage including runbooks and data dictionary completeness
Requirements
- Bachelor’s Degree preferred in a related field
- 6+ years of experience in data engineering, ETL/ELT, or related roles
- Hands on experience building and supporting production pipelines in Azure Data Factory
- Strong SQL and T-SQL skills with SQL Server environments supporting analytics and reporting workloads
- Advanced data modeling
- Experience integrating data from multiple sources including databases, flat files or SFTP, and APIs/vendor feeds
- Familiarity with Azure data platform components (Data Lake/Blob Storage, notebooks) and/or cloud migration planning
- Strong troubleshooting, root cause analysis, and operational ownership mindset
- Ability to work directly with stakeholders to gather requirements and translate them into technical solutions
- Strong communication and documentation skills for clear, effective collaboration
Technologies
- Azure Data Factory
- SQL Server, T-SQL
- Data Lake/Blob Storage, notebooks
- Power BI, Git, CI/CD
- Python, PowerShell
- SFTP
Compensation
The posted salary range for this remote role is USD 75,000 to 100,000 per year. The final offer may vary based on geographic location and other factors. Additional compensation may include an annual bonus or incentive opportunities.
EEO Statement
The Hanover values diversity in the workplace and among our customers. We provide equal opportunity for employment and promotion to all qualified individuals on the basis of experience, training, education and ability, without regard to race, religion, color, age, sex, sexual orientation, national origin, gender identity, disability, marital status, veteran status, or any other status protected by law. We are committed to an equal opportunity workplace that is free of discrimination and harassment. Individuals with disabilities who require accommodation should contact HRServices@hanover.com and include the job posting link.
