Data Engineer

DCI Solutions is seeking a Data Engineer to join a cross-functional team in New York, onsite. The role centers on integrating data, transforming insights, and building applications to support operational decisions, with an active DoD Secret Clearance required.

Responsibilities

• Operate as a Data Engineer on a cross-functional team to help address critical problems
• Integrate data from multiple sources
• Transform insights into actionable information for decision making
• develop first-class applications that support operational decisions
• Set up data feed transfers from source systems to the designated location
• Write data transformations
• Derive new datasets using Spark for distributed computation
• Monitor build progress and troubleshoot issues
• Design applications that answer operational questions
• Respond to information requests (RFIs) related to the platform's data footprint
• Collaborate with product teams while debugging and understanding the code behind the core platform

Requirements

• BS in Computer Science or Engineering (or related field) preferred
• 3+ years of experience in data transformation, data engineering, and software engineering
• Proficiency with Python and Java
• Proficiency with TypeScript/JavaScript
• Experience with Spark, PySpark, and/or Pandas
• Strong understanding of algorithms and data structures as they pertain to development and problem solving
• Foundry experience preferred
• Active DoD Secret Clearance is required
• Security clearance: Secret (Required)

Experience

• Data engineering: 5 years (Preferred)
• Python coding/programming: 5 years (Preferred)
• Building and managing data pipelines: 5 years (Preferred)
• Data transformation: 5 years (Preferred)
• Foundry: 1 year (Preferred)
• Spark and/or PySpark: 3 years (Preferred)

Technologies

• Spark
• PySpark
• Pandas
• Python
• Java
• TypeScript
• JavaScript
• Foundry

Benefits

• 401(k)
• 401(k) matching
• Dental insurance
• Flexible schedule
• Flexible spending account
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Parental leave
• Professional development assistance
• Relocation assistance
• Retirement plan
• Tuition reimbursement
• Vision insurance

Location

New York, NY

Job Type

Full-time

Salary

$175,000 - $260,000 per year

Security Clearance

Secret (Required)

Work Location

In person