Data Engineer - Active TS/SCI
Job Description
Benefits
- Growth: AI powered career tool that identifies career steps and learning opportunities
- Support: An internal mobility team focused on helping you achieve your career goals
- Rewards: Comprehensive benefits and wellness packages, 401K with company match, competitive pay, and paid time off
- Community: Award winning culture of innovation and a military friendly workplace
Responsibilities
- Identify and implement internal process improvements, redesigning infrastructure for scalability, optimizing data delivery, and automating manual tasks
- Develop and design data pipelines to support an end to end solution
- Develop and maintain artifacts such as schemas, data dictionaries, and ETL transforms
- Integrate data pipelines with AWS cloud services to derive meaningful insights
- Collaborate with stakeholders to support data infrastructure needs and assist with data related technical issues
- Design and develop robust dataflows to support raw data and expected data
- Provide Tier 3 technical support for deployed applications and dataflows
- Define and communicate a clear product vision for client software products, aligning with user needs and business objectives
- Create and manage product roadmaps that reflect innovation and growth strategies
- Partner with a government product owner and a product team of 7-8 FTEs
- Collaborate with the data engineering team to design and launch new features
- Coordinate and document dataflows, capabilities, and related artifacts
- Occasionally support off hours deployments such as evenings or weekends as needed
Requirements
- 5+ years of experience
- Bachelor’s degree or equivalent practical experience
- Expertise in distributed computing frameworks for large scale data processing
- Familiarity with Amazon Web Services (AWS) or other cloud environments
- Experience with datastores such as PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch, and SQL
- Proficient in Python with libraries including pandas and PySark, NiFi, Airflow, AWS Lambda or similar technologies
- Working knowledge of Docker, Kubernetes, JMS/SQS, SNS, and Kafka
- Experience with Linux/Unix server environments
- Experience with Agile development methodology
- Experience publishing and/or presenting design reports
- Ability to coordinate with team members to reach project milestones and deadlines
- Working knowledge of Jira and Confluence
- Must be able to obtain and maintain a DHS EOD (Entry On Duty)
Technologies
- AWS
- PostgreSQL
- S3
- Redshift
- MongoDB
- DynamoDB
- Redis
- Elasticsearch/OpenSearch
- SQL
- Python
- pandas
- PySark
- NiFi
- Airflow
- AWS Lambda
- Docker
- Kubernetes
- JMS
- SQS
- SNS
- Kafka
- Linux
- Unix
- Jira
- Confluence
- GovCloud
- DevOps
- Object Oriented Programming languages
- Scripting
Work requirements
- 5 + years of related experience
- May vary based on technical training, certifications, or degree
- Travel Required: None
- Citizenship: U.S. Citizenship Required
- Must be able to obtain and maintain a DHS EOD