Data Engineer, Mid
Job Description
Join Booz Allen Hamilton to help modernize a U.S. Army program’s ability to capture, preserve, and reuse data from high-value system test events. You will build secure, organized, searchable data storage and processing capabilities that support trusted analytics, reporting, partner-facing metrics, and model training as configurations evolve. This onsite role at Fort Belvoir, VA offers a benefits package that supports health, financial security, and career growth.
Responsibilities
- Design and implement dependable data storage and processing capabilities that replace manual file transfers and fragmented local copies with secure, organized, searchable repositories.
- Help ensure valuable datasets stay discoverable, accurate, and useful as the deployed software system and its configurations evolve.
- Partner with software developers, systems engineers, test personnel, and AI/ML practitioners to automate ingestion, validation, relevance-based curation, indexing, version tracking, and backup and recovery.
- Preserve data provenance and maintain test-event and software-version context to enable performance analysis, government reporting, partner-facing metrics, and model training.
- Create a foundation for future automated dashboards and controlled data access for authorized stakeholders.
- Implement ingestion pipelines with validation, relevance-based filtering, logging, alerts, automated retries, and failure recovery to keep data accurate and available.
- Manage retention and reuse using test-event and source metadata, dataset provenance, software-version traceability, relevance-based curation, automated backups, and recovery testing.
Requirements
- 4+ years of experience in data engineering, database development, or data-platform work supporting software or test environments, including Python, SQL, data transformation, complex queries, source control with Git, automated testing, and peer review.
- Experience deploying, configuring, securing, monitoring, tuning, backing up, and troubleshooting locally hosted relational or NoSQL databases, including schema and data modeling, indexing, query optimization, data integrity, and controlled access.
- Experience building and operating scheduled batch or near-real-time ETL/ELT pipelines that ingest data from files, APIs, applications, and databases, with validation, relevance-based filtering, logging, alerts, automated retries, and failure recovery.
- Experience managing data retention and reuse through test-event and source metadata, dataset provenance, software-version traceability, relevance-based curation, automated backups, and recovery testing.
- Ability to translate developer, tester, and stakeholder needs into supportable data solutions.
- Secret clearance.
- HS diploma or GED.
Technologies
Python, SQL, Git, ETL, ELT, Redis, PostgreSQL, object storage, Apache Airflow, Dagster, Prefect, GitLab, Azure DevOps, Jira, DVC, lakeFS, Power BI, Grafana, Tableau, Linux, Docker, Kafka, Spark
Benefits
- Health, life, disability, financial, and retirement benefits
- Paid leave
- Professional development
- Tuition assistance
- Work-life programs
- Dependent care
- Recognition awards program acknowledging employees for exceptional performance and superior demonstration of Booz Allen’s values
- Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs
Nice If You Have
- Experience supporting U.S. Army or other DoD software development, testing, evaluation, or sustainment programs, particularly with test-event datasets, telemetry, application logs, system performance metrics, or technical reporting.
- Experience with Redis architectures, including data structures, indexing, and persistence, together with complementary technologies such as PostgreSQL, object storage, or on-premises data platforms for durable, high-performance retrieval.
- Experience preparing reproducible AI/ML training, evaluation, or inference datasets through profiling, labeling, normalization, deduplication, feature preparation, and version tracking.
- Experience supporting Agile or Scrum software teams with CI/CD and repeatable deployments, including orchestration tools such as Apache Airflow, Dagster, or Prefect and planning or release tools such as GitLab, Azure DevOps, or Jira.
- Experience implementing data catalogs, metadata management, data lineage, schema-evolution controls, or dataset versioning using methods and tools such as DVC, lakeFS, data contracts, or comparable governance practices.
- Experience building automated performance dashboards and traceable reports with Power BI, Grafana, Tableau, or Python visualization tools, including drill-down links or references to source datasets.
- Experience working in Linux-based, on-premises, restricted, or disconnected environments using Docker or other containers, secure networking, role-based access, audit logging, or controlled remote or API access.
- Experience with event-driven or distributed data processing such as Kafka or Spark.
Work Model
Onsite: Work will primarily be performed full-time at a customer facility, where employees will collaborate directly with colleagues and customers as required by the role.
Security and Identity
- Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; Secret clearance is required.
- As part of the hiring process, you will complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud.
- You are expected to be on camera during interviews and assessments, and Booz Allen reserves the right to take your picture to verify your identity and prevent fraud.
Candidate AI Usage Policy
The use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided.