Senior Data Engineer
Senior
Big Data
Bigdata
Cloud Data Engineering
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lake
Data Pipeline
Data Platform
Data Processing
Database
Databases
Databricks
ETL
Graph Databases
Informatica
Information Technology (IT)
MySQL
PostgreSQL
Programming Language
Programming Languages
SQL
Job Description
Castalia Systems is hiring a Senior Data Engineer to build and operate reliable data pipelines that support national security users in a hybrid setting in Arlington, VA.
Responsibilities
- Ensure data availability by enabling seamless movement, modification, and storage of critical data
- Support scalable deployment of data pipelines
- Design, implement, and maintain Extract Transform Load (ETL) data processes
- Collaborate with Software Engineers and Data Scientists to support high-priority national security needs
Requirements
- BS Degree
- 8+ years of professional experience needed for most opportunities
- Python experience for data manipulation and scripting
- Databricks experience
- Proficiency in designing and implementing ETL data processes
- Experience with at least one relational database: PostgreSQL, MySQL, or SQLite
- Experience with Agile SCRUM methodologies
Technologies
- Python
- Databricks
- Extract Transform Load (ETL)
- PostgreSQL, MySQL, SQLite
- Agile SCRUM
- NiFi
- SQL
- NoSQL
- Graph Databases
- Data Lakes
- Qlik
Preferred Qualifications
- Familiarity with database design, server management, connection protocols, and database normalization
- Familiarity with principles of information theory
- Experience with data cleaning or data organization
- Familiarity with NiFi, SQL, NoSQL, Graph Databases, and Data Lakes
- Experience with dashboarding tools similar to Qlik
- Familiarity with cybersecurity, including design and implementation of unique data transfer protocols
Job Type, Location, and Clearance
- Job Type: Full-Time
- Workplace Type: Hybrid
- Location: Arlington, VA
- Clearance: Active Secret clearance
- Citizenship: Must be a U.S. Citizen
Work Environment and Travel
- ONSITE: 3-5 days per week
- Normal office environment
- Travel: As needed
Compensation
- Projected salary range: $150,000 to $160,000 (annualized USD)
Benefits
- Medical, dental, vision coverage
- 401k matching
- Generous PTO
- Paid holidays
- Professional training opportunities
- Pet insurance
Mission Context
- Develop and deploy AI and Machine Learning applications that support national security missions
- Support 19 key Principal Staff members (Senior Executive Service and General Officers) within the Office of the Undersecretary of Defense (OUSD) and the Intelligence Community
Candidate Profile
- Motivated technologist who works well with limited direction
- Passion for continuous learning
- Ability to pivot quickly across new languages and technologies to solve complex problems
Similar Jobs
