Data Engineer
Job Description
NeoMax is seeking a Data Engineer (onsite in Herndon, VA) who brings a Systems Engineer background and a strong data engineering foundation. This role focuses on turning complex, distributed data into reliable lake-ready datasets while supporting analysis of networks, systems, and log data across environments that include shared networks and multiple security enclaves. You will also work with Splunk and scripting tools to keep data pipelines operating smoothly.
What you’ll do
- Integrate diverse data streams into a data lake
- Ensure unstructured data is structured at time of load
- Establish data standards and act as custodian of IT and service delivery data sets and streams
- Analyze complex networks and systems to support visibility and operational understanding
- Analyze log data from various network components and operating systems
- Manage and troubleshoot data feeds
- Use Python and BASH scripting to support pipeline and data processing work
What you’ll need
- Minimum 16 years of experience
- Bachelor’s or master’s degree
- Experience integrating diverse data streams into a data lake
- Experience with ETL and ensuring unstructured data is structured at time of load
- Experience with data transfer tools (example: NiFi, Cribl)
- Experience establishing data standards and serving as custodian of IT and service delivery datasets and streams
- Experience analyzing complex networks and systems
- Experience analyzing log data from network components and operating systems
- Knowledge of complex environments involving shared networks and multiple security enclaves
- Systems Engineer with Data Engineer background
- Ability to manage and troubleshoot data feeds
- Splunk CORE User certification prior to start
- Splunk CORE Power User certification within 3 months from start
Technologies you’ll work with
- Python, BASH Scripting, ShellScript
- NiFi, Cribl
- Splunk
Desired background
- Security Development and Operations (SecDevOps)
- Hands-on Splunk experience and certifications
- Scripting tools including Python, ShellScript, or Ansible
- Cloud security controls and implementation
- Public, private, and hybrid Cloud experience (AWS, Microsoft Azure, etc.)
- AWS Certified Security Specialty