Data Engineer
Job Description
Freshfields is building a modern, cloud-first data and AI platform, and the Global Data Office is seeking a hands-on Data Engineer to help deliver trusted, governed data for reporting, analytics, AI and machine learning. This onsite role is based in Raleigh, NC and focuses on building scalable data pipelines and data products on Microsoft Azure using Databricks and Delta Lake, alongside data governance and data quality initiatives.
What you will do
You will design, develop, and maintain batch and near real-time ETL/ELT pipelines using Azure Data Factory, Databricks, PySpark, and SQL. You will support ingestion, transformation, and delivery of data coming from multiple enterprise source systems, and build reusable processing components that align with established engineering standards.
Key focus areas include delivering and operating lake and lakehouse solutions with Azure Data Lake, Databricks, and Delta Lake, while enabling analytics, reporting, and self-service data consumption through data model implementations and reusable data products and datasets.
You will also contribute to data reliability and trust by implementing data quality controls, validation frameworks, and monitoring processes within data pipelines. Collaboration across the Data Office is central, including metadata management, data cataloguing, and lineage activities using tools such as Collibra and Purview.
In day-to-day operations, you will monitor pipelines and processing workloads to ensure operational stability, investigate and resolve data and platform issues in a timely manner, and identify opportunities to improve performance, scalability, and cloud cost efficiency. You will work with Data Architects, Lead Data Engineers, Data Analysts, and business stakeholders to deliver solutions aligned to business requirements, participating in agile ceremonies including sprint planning, stand-ups, and retrospectives.
Additional responsibilities include supporting testing, deployment, and release activities for data products and platforms, contributing to source control and automated deployment/testing using Git and Azure DevOps, following coding and documentation expectations, and participating in peer reviews and continuous improvement initiatives.
Requirements
- 3–5 years of experience in data engineering or a related technical discipline.
- Experience building ETL/ELT pipelines in the cloud environment, preferably Microsoft Azure.
- Hands-on experience with Databricks, SQL, and Python/PySpark.
- Experience with enterprise data platforms and architectures such as data warehouses, data lakes, or lakehouse.
- Familiarity with data governance, metadata management, and data quality concepts.
- Experience using Git and contributing to CI/CD delivery processes.
- Strong stakeholder engagement and collaboration skills.
- Bachelor’s degree in computer science, Engineering, Information Systems or a related field, or equivalent practical experience.
- Experience with Azure Data Lake Storage Gen2.
- Experience with Azure Data Factory.
- Experience with Azure Synapse Analytics.
- Azure Functions (desirable).
- Strong SQL skills.
- Good working knowledge of Python and PySpark.
- Understanding of Delta Lake concepts and modern lakehouse architectures.
- Familiarity with dbt (data build tool).
- Exposure to CI/CD practices using Azure DevOps or GitHub.
- Basic understanding of orchestration tools such as Apache Airflow.
- Awareness of data governance principles, metadata management, and data lineage.
- Experience with Collibra, Purview, or similar governance platforms is advantageous.
- Understanding of data quality frameworks and controls.
- Strong analytical and problem-solving skills.
- Effective verbal and written communication skills.
- Ability to work collaboratively across technical and business teams.
- Comfortable working within Agile delivery environments.
- Curious mindset with a willingness to learn new technologies and capabilities.
- Strong attention to detail and commitment to delivering high-quality solutions.
Technologies
- Microsoft Azure
- Azure Data Factory
- Databricks
- Delta Lake
- PySpark
- SQL
- Python
- Azure Data Lake
- Azure Data Lake Storage Gen2
- Azure Synapse Analytics
- Azure Functions
- Collibra
- Purview
- Git
- Azure DevOps
- GitHub
- dbt (data build tool)
- Apache Airflow
- ETL
- ELT
Role overview
This position is part of a team responsible for maintaining and evolving Freshfields’ modern cloud-based data infrastructure, including scalable data pipelines and data products built on Azure, Databricks, and Delta Lake. The role supports enterprise data governance and quality initiatives, helps make trusted governed data available across the organisation, and collaborates with architects, analysts, and business teams to address complex data challenges.
The environment is fast-paced and evolving, with the need for resilience, flexibility, and a constructive approach to change. The role involves collaboration across geographically dispersed teams and multiple office locations, with opportunities to learn from senior engineers and grow technical and professional capabilities.