Data Engineer
Backend Developer
Azure
Big Data
Bigdata
Cloud
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Management
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Database
Databases
Databricks
ETL
GCP
Informatica
Information Technology (IT)
SQL
Job Description
Data Engineer role supporting USTRANSCOM’s Global Bulk Fuel Management and Delivery (GBFMD) mission through enterprise data pipelines, integrations, and APIs.
Responsibilities
- Develop and maintain data pipelines that ingest and manage data in Databricks, including integrations with Palantir Ontology and other enterprise platforms.
- Partner with cross-functional teams to support Common Operating Picture (COP) development and related data integration efforts.
- Review and analyze Joint Petroleum Enterprise (JPE) data sources across applications, websites, programs, and operational systems to identify integration and improvement opportunities.
- Design and implement scalable ingestion processes that transform source data into structured formats for enterprise consumption and API development.
- Develop, publish, and maintain APIs providing standardized access to enterprise data for JPE stakeholders.
- Collaborate with stakeholders to maintain enterprise data dictionaries, metadata repositories, and data governance artifacts.
- Administer data structures, data topics, and data engineering processes while applying industry best practices.
- Participate in technical working groups and stakeholder meetings to support metadata requirements, data modeling, architecture decisions, and tool selection.
- Support preparation of presentations and technical materials for USTRANSCOM, Joint Staff, and Office of the Secretary of Defense governance forums.
- Provide technical recommendations supporting enterprise data modernization initiatives.
- Complete additional projects and tasks as assigned by program leadership.
Requirements
- Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- 5+ years of experience in data engineering, software development, or a related technical discipline.
- Strong proficiency with SQL and Python.
- Experience building and maintaining pipelines using Apache Spark, Kafka, or similar technologies.
- Experience with cloud platforms: AWS, Microsoft Azure, or Google Cloud Platform.
- Experience designing and implementing data integration solutions.
- Ability to communicate effectively with both technical and non-technical stakeholders.
- Active Secret clearance with eligibility to obtain and maintain a TS/SCI.
Technologies
- SQL
- Python
- Databricks
- Palantir Ontology
- Apache Spark
- Kafka
- AWS
- Microsoft Azure
- Google Cloud Platform
Desired
- Experience with Databricks.
- Experience with Palantir Ontology.
- Experience with data warehousing, ETL processes, and enterprise data management.
- Experience with API development and RESTful web services.
- Experience with data modeling techniques and metadata management.
- Experience with Maven Smart Systems or similar logistics and supply chain platforms.
- Experience supporting the Department of Defense, Defense Logistics Agency (DLA), or USTRANSCOM.
- Experience supporting Agile development environments.
Benefits
- Competitive salary
- Benefits
- 401(k)
- Bonus and profit sharing
- Flexible hours
- Education reimbursement
- PTO
Eligibility Requirements
- Secret clearance with ability to obtain and maintain TS/SCI.
- Ability to travel within CONUS up to approximately 10%.
- Restricted to U.S. persons as defined under 8 U.S.C. 1324b(a)(3).
Location and Salary
- Location: Onsite at Scott Air Force Base, Illinois (St. Louis, MO)
- Salary: $125,000 - $150,000 per year
Similar Jobs
S