EngineerJobs.io
← Back to all jobs

Job Description

Guidehouse Inc. is looking for a Cleared Data Engineer to help build and support scalable data processing for cybersecurity metrics, risk analysis, and executive reporting. The role is based in Arlington, VA and focuses on designing batch and streaming pipelines in Databricks with strong attention to data quality, orchestration, and governance.

This position requires an Active Secret federal security clearance and includes close collaboration with cybersecurity analysts, data owners, system administrators, and dashboard teams to ensure data products meet defined requirements and operational needs.

What You’ll Do

  • Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines in Databricks using Python, PySpark, SQL, and reusable engineering patterns.
  • Transform raw inputs into curated, analysis-ready datasets and dimensional models for cybersecurity metrics, risk analysis, dashboards, and executive reporting.
  • Create automated data-quality controls for ETL, covering schema, completeness, validity, consistency, uniqueness, timeliness, referential integrity, and source-to-target reconciliation.
  • Define handling for failed quality checks, including quarantining invalid records, stopping critical loads, generating alerts, documenting exceptions, and coordinating corrective actions with data owners.
  • Schedule and orchestrate production workflows, monitoring job status, freshness, throughput, latency, resource utilization, and failures, then troubleshoot and restore processing within agreed service levels.
  • Improve reliability, performance, and cost using efficient transformations, incremental processing, partitioning, and compute-resource management.
  • Implement and maintain data governance and quality-assurance standards, including access controls, metadata, data classification, ownership, lineage, retention, auditability, and protection of sensitive cybersecurity information.
  • Maintain operational and audit documentation such as source-to-target mappings, data dictionaries, transformation rules, validation evidence, and runbooks/SOPs.
  • Collaborate with stakeholders to define data requirements, metrics, thresholds, and acceptance criteria.
  • Support client engagement through timely communication of delivery risks and dependencies, and by resolving issues professionally.
  • Organize and lead client meetings by coordinating schedules, preparing agendas and pre-read materials, capturing minutes, maintaining required documentation, and tracking action items through closure.
  • Participate in peer reviews, testing, release activities, and continuous improvement to strengthen engineering practices and reduce recurring defects.

What You’ll Need

  • An ACTIVE and CURRENT SECRET federal security clearance.
  • Bachelor’s degree.
  • Six (6) years total experience in a data or programming discipline, including Three (3) years in data engineering.
  • Proficiency in data engineering programming languages such as Python, PySpark, and/or SQL.
  • Experience with scheduling, monitoring, troubleshooting, and optimizing production ETL/ELT pipelines.
  • Experience with data engineering principles and best practices.
  • Excellent problem-solving skills and attention to detail.
  • Ability to commute to client and Guidehouse offices as needed.

Technologies

  • Databricks
  • Python
  • PySpark
  • SQL

Benefits

  • Medical, Rx, Dental & Vision Insurance
  • Personal and Family Sick Time & Company Paid Holidays
  • Position may be eligible for a discretionary variable incentive bonus
  • Parental Leave and Adoption Assistance
  • 401(k) Retirement Plan
  • Basic Life & Supplemental Life
  • Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
  • Short-Term & Long-Term Disability
  • Student Loan PayDown
  • Tuition Reimbursement, Personal Development & Learning Opportunities
  • Skills Development & Certifications
  • Employee Referral Program
  • Corporate Sponsored Events & Community Outreach
  • Emergency Back-Up Childcare Program
  • Mobility Stipend

Location: Arlington, VA (onsite)
Compensation: USD 85,000 - 141,000 per yearly
Experience Level: 3+ years required
Travel Required: Up to 50%
Clearance Required: Active Secret

What Would Be Nice To Have

  • Master’s degree in computer science or related field
  • Experience working with system and application logs
  • Familiarity with the Databricks platform
  • Strong communication and collaboration skills in a team environment

Similar Jobs