Data Engineer

Steampunk is seeking a seasoned Data Engineer to lead enterprise data platform and pipeline architecture for clients on a federal program.

Responsibilities

• Lead and architect data pipelines and ingest patterns that move raw data from producers into an enterprise data ecosystem, with emphasis on performance and reliability
• Assess and understand ETL jobs, workflows, BI tools, and reports
• Provide technical support for inquiries related to customization, integration, enterprise architecture, and general data product functionality
• Support an Agile software development lifecycle
• Contribute to the growth of the Data Exploitation Practice

Requirements

• Experience supporting ICE contract work
• Experience working in Design Intelligence
• Bachelor’s Degree and 6+ years total experience, or equivalent experience and education
• 6+ years direct experience in Data Engineering
• Inspect existing data pipelines to determine purpose and functionality, then re-implement them efficiently in Databricks
• Advanced working knowledge of SQL and experience working with relational databases
• Advanced working knowledge of NoSQL databases
• Experience with message queuing, stream processing, and highly scalable big data data stores
• Experience manipulating, processing, and extracting value from large, disconnected datasets
• Experience manipulating structured and unstructured data for analysis
• Experience with data modeling tools and processes
• Experience aggregating and transforming data from multiple datasets to create data products
• Experience working in an Agile environment

Tools and Technologies

• Python, SQL, R
• Databricks
• AWS Data Services, EC2, S3, RDS, Glue, Step Functions, Lambda, EMR, DynamoDB, Athena
• Hadoop, Spark, Spark-Streaming
• Kafka, Storm
• Postgres, Cassandra, DocumentDB, Redshift, Aurora
• Azkaban, Luigi, Airflow
• Additional languages/tools listed: Scala, Go, Spark-Streaming

Location

• McLean, VA (onsite)

Compensation

• USD 110,000 - 160,000 per year

Steampunk uses salary criteria that include geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The annual salary range for this position is shown above, and annual salary is one component of the total compensation package. Steampunk is an equal opportunity employer and participates in the E-Verify program. As part of the application process, you are expected to be on camera during interviews and assessments; Steampunk reserves the right to take your picture to verify identity and prevent fraud.