Data Engineer
Job Description
Data Engineer position in Huntsville, AL focused on building data pipelines, integrating sources for dashboards, analytics, and compliance reporting, with emphasis on security and governance.
Responsibilities
- Coordinate with internal and external stakeholders to collect, normalize, and analyze data assets across multiple projects and platforms.
- Design, build, maintain, evaluate, and test data solutions that deliver measurable value.
- Define and implement plans, policies, and practices to control, protect, deliver, and enhance the integrity of data and information assets.
- Ingest, store, process, and analyze raw and complex data from diverse sources; select and design optimal data solutions and build processing pipelines using data warehousing concepts and modern database technologies.
- Investigate data quality issues, perform root-cause analysis, correct errors, and develop prototypes and process-improvement plans across programs, including proofs of concept for chosen solutions.
- Transform unstructured data into analysis-ready formats and conduct subsequent analyses.
- Integrate innovations and algorithms into the organization’s data systems in collaboration with the engineering team.
- Deliver complex data projects focused on collecting, parsing, managing, analyzing, and visualizing large data sets to generate insights across platforms.
- Establish and enforce data security protocols to protect all data used by the organization.
- Ensure day-to-day compliance with policies, processes, and procedures.
- Support data needs and assist in gathering data for various operational requirements.
- Perform data analysis, problem solving, investigation, and creative thinking with large data sets; maintain source code control.
- Create and maintain data ingestion and transformation pipelines within Vantage and Gabriel Nimbus.
- Other duties as assigned.
Requirements
- Bachelor’s degree in science, technology, engineering, mathematics, IT, or business-related programs.
- 4+ years of experience in building data pipelines, data transformation, and integrating sources for dashboards, AI/ML, analytics, and compliance reporting.
- Active Secret clearance with the ability to obtain TS with SCI eligibility.
- Successfully pass background and drug screening.
Knowledge, Skills and Abilities
- Proficiency in Python and SQL.
- Experience with cloud platforms such as AWS, Microsoft Azure, and Google Cloud Platform, including migrating projects to the cloud.
- Experience working in Unix/Linux environments.
- Experience with NoSQL databases.
- Experience consuming data via APIs and transforming JSON data.
- Familiarity with cloud infrastructures and hybrid cloud environments.
- Strong Microsoft Office skills (Word, Excel, PowerPoint, Outlook).
- Understanding of cloud technologies (AWS, Azure, GCP, Oracle) and hybrid cloud environments.
- Knowledge of CI/CD tools and practices.
- Experience with relational databases and BI tools such as Power BI or Business Objects (BO).
- Experience extracting, transforming, and structuring data to support exploratory analytics and operational reporting.
- Ability to create data visualizations that enable quick interpretation and action.
- Solid data analysis, engineering, and data management capabilities.
- Excellent time management and organizational skills; able to work independently and in a team; able to meet minimum clearance requirements.
- Ability to travel up to 10% and to work nights, weekends, and holidays as required.
Technologies
- Python
- SQL
- AWS
- Microsoft Azure
- GCP
- Oracle
- NoSQL
- Unix/Linux
- Vantage
- Gabriel Nimbus
- Power BI
- Business Objects (BO)
- CI/CD