Senior Data Engineer
Job Description
Senior Data Engineer position at ICF (onsite) focused on scalable cloud data pipelines, trusted data products, and AI-enabled data platform operations.
Responsibilities
- Design, build, and operate batch and streaming data pipelines on modern cloud data platforms
- Develop ETL/ELT workflows using SQL, Python, and PySpark with strong error handling, monitoring, and cost awareness
- Implement layered / medallion architectures and analytics-ready data models for BI and AI workloads
- Collaborate with analysts and data scientists to deliver trusted, production-grade data assets
- Support and enhance data governance practices using Microsoft Purview (or comparable governance platforms)
- Contribute to governance standards and best practices for data products, analytics solutions, AI/ML features, and agent-based workflows as capabilities evolve
- Embed governance considerations into platform workflows and engineering practices rather than treating governance as an after-the-fact process
- Contribute to AI-enabled tools and automation workflows that support data platform and governance operations
- Partner with technical teams to explore automation for metadata enrichment, data quality checks, anomaly detection, and governance workflows
- Help ensure AI-enabled tools operate only on approved, governed data sources with appropriate logging and auditability
- Support evolving AI governance patterns, including agent lifecycle management and input/output traceability (with team support)
- Implement and maintain CI/CD pipelines for data and AI assets
- Promote infrastructure-as-code practices using Terraform, Bicep, or equivalent for repeatable, governed environments
- Define environment promotion paths (dev, test, prod) with embedded governance and policy checks
Requirements
- Bachelor’s degree AND 5+ years of experience in data engineering or data platform engineering in a production environment
- SQL plus hands-on experience with Python and PySpark
- Experience in data engineering on at least one major cloud/data platform (Azure, AWS, Databricks, or equivalent) with transferable skills across platforms
- Experience with Git-based development and CI/CD practices
- Working knowledge of data governance concepts such as cataloging, lineage, data quality, or access control
- Demonstrated engineering judgment to balance delivery speed, reliability, safety, and governance considerations
Technologies
- SQL, Python, PySpark
- Azure, AWS, Databricks
- Microsoft Fabric, Microsoft Purview
- Git, CI/CD
- Terraform, Bicep
- ETL, ELT
Preferred Qualifications
- Exposure to Microsoft Purview or comparable data governance platforms
- Interest in or experience supporting AI agents, LLM-based automation, intelligent assistants, or other automation for operational or platform workflows
- Exposure to embedding governance controls into DevOps workflows, or interest in developing a policy-as-code mindset
- Familiarity with Microsoft Fabric or Databricks-centric architectures, and ability to learn new platforms quickly
Location and Work Details
- Location: Reston, VA
- Work mode: Onsite
- Nationwide Remote Office (US99): available for the pay range context provided
Compensation
- Salary range: USD 98,614 - 167,644 per yearly
- Pay range note: Pay range based on full-time employment is $98,614.00 - $167,644.00
Application Notes
- This application must be submitted directly by the applicant for consideration. Failure to do so may result in the application being excluded for consideration.
- For disability or religious accommodations related to the application process, contact [email protected].
Working at ICF
- ICF is a global advisory and technology services provider.
- Equal opportunity employer.
- Qualified applicants with arrest and conviction records will be considered for employment.
- Reasonable accommodations are available for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs. To request an accommodation, email [email protected].
- All information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.
Candidate AI Usage Policy
- Use of AI tools to generate or assist with interview responses is not permitted (in-person or virtual) to ensure a fair interview process.
- AI-related accommodations may be available. Candidates should contact [email protected] in advance if an accommodation is needed.