Senior Data Engineer
Job Description
Senior Data Engineer role at General Dynamics Information Technology in Fort Bragg, NC (hybrid) focusing on leading data engineering initiatives for high priority government projects, building robust data pipelines and architecture.
Responsibilities
- Design, develop, and deploy data pipelines and ETL processes using Python, Airflow, and NiFi to enable secure and efficient data processing
- Develop scalable micro services for data handling and transformation to support high-volume ingestion and processing
- Curate, cleanse, and secure data to ensure accurate and safe transfers across multiple classification levels
- Create solutions supporting both batch and streaming data processing
- Integrate data pipelines with data lakes, data warehouses, and databases to boost accessibility and efficiency
- Collaborate with cross-functional teams to deliver mission-critical data requirements
- Ensure adherence to data handling best practices and security requirements when working with classified datasets
- Apply data visualization techniques to make data more accessible and actionable for mission teams
Requirements
- Proficiency in Python
- Regular expressions scripting
- SQL experience, with preference for PostgreSQL and TSQL
- Git
- Docker
- Trino
- Familiarity with Kubernetes and Helm charts
- Experience deploying software in Kubernetes using Argo
- Airflow
- NIFI
- Elasticsearch and AWS OpenSearch
- Linux environment experience
- Database optimization
- Familiarity with graph databases
Technologies
- Python
- Airflow
- NIFI
- PostgreSQL
- TSQL
- Git
- Docker
- Trino
- Kubernetes
- Helm charts
- Argo
- ElasticSearch
- AWS OpenSearch
- Linux
- Databricks
- Snowflake
- AWS
- GCP
- Graph database management familiarity
Benefits
- Growth: AI powered career tool that identifies career steps and learning opportunities
- Support: Internal mobility team focused on helping you achieve your career goals
- Rewards: Comprehensive benefits and wellness packages, 401K with company match, competitive pay and paid time off
- Community: Award-winning culture of innovation and a military-friendly workplace
Work Requirements
- Years of Experience: 8+ years of related experience
- May vary based on technical training, certification(s), or degree
- Certification
- Travel Required: None
- Citizenship: U.S. Citizenship Required
Salary and Benefits Information
The likely salary range for this position is $111,350 - $150,650 per year. This range is not a guaranteed offer and will be determined based on experience, geographic location, and contractual requirements, and could fall outside this range. See additional information about benefits and the total rewards program.
Our Identity Verification Process
As part of the hiring process, candidates complete an identity verification process that uses biometric and AI-based methods to ensure authenticity and prevent fraud. Virtual interviews require on-camera participation, and a photo may be captured to verify identity and prevent fraudulent activity. By proceeding, you authorize collection, processing, and use of biometric data for identity verification and security purposes.
About Our Work
We are GDIT, a global technology and professional services company delivering technology and mission services to every major U.S. government agency, including defense and intelligence communities. Our 26,000 experts apply technology to create immediate value and deliver solutions at the edge of innovation. We operate in over 50 countries worldwide, offering capabilities in digital modernization, AI/ML, cloud, cyber, and application development.