Data Engineer

The Data Engineer role at Agile Defense supports the development and ongoing maintenance of secure data pipelines and analytics-ready datasets. You will help process structured and unstructured data in collaboration with data scientists, engineers, and mission stakeholders, using specified data platforms and related technologies.

Role Summary

This position focuses on building and maintaining secure data pipelines, ETL/ELT workflows, and datasets prepared for analytics use. You will work across multiple data sources and structures, applying engineering practices to ensure reliable data processing within the organization’s required platforms.

Key Responsibilities

• Develop and maintain secure data pipelines, ETL/ELT workflows, and analytics-ready datasets.
• Partner with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.

Required Qualifications

• Bachelor’s degree in computer science, data science, engineering, information systems, mathematics, or a related technical field.
• Equivalent combinations of education, technical certification, and relevant professional experience may be considered.
• 3+ years of relevant experience in data engineering, software development, data analytics, or enterprise-platform work.
• Experience with Python and familiarity with SQL, including data validation, data modeling, and data-quality practices; familiarity with Spark, PySpark, Databricks, or comparable technologies.
• Experience supporting ETL/ELT pipelines and data transformations.
• Understanding of version control, testing, documentation, and Agile development.
• Ability to collaborate with technical and nontechnical stakeholders.
• Active US government security clearance.

Technologies

• Python
• SQL
• Spark
• PySpark
• Databricks
• Palantir Foundry
• Maven Smart Systems

Preferred Skills

• Experience with Palantir Foundry, Maven Smart Systems, or War Data Platform.
• Exposure to Docker, CI/CD, MLflow, APIs, or Terraform.
• Familiarity with AWS or Azure.
• Familiarity with DoD data environments and classified networks.
• Prior Combatant Command support.
• Strong Python and SQL skills with familiarity in JavaScript/TypeScript.

Working Conditions

This role requires the ability to work onsite in a SCIF.

Clearance Requirements

Candidates must be U.S. citizens and possess, at minimum, an active Secret security clearance. Some assignments may require higher-level clearances, including TS/SCI, which candidates must be able to obtain and maintain based on project requirements.

Location and Compensation

Location: Honolulu, HI (onsite).
Compensation: USD 135,000 - 165,000 per year.