Data Engineer

DCI Solutions is hiring a Data Engineer in New York, NY (onsite) to integrate data, build Spark-based transformations, and support a cross-functional team solving operational problems. This is a full-time role with a strong benefits package, including health and retirement options, paid time off, professional development assistance, and parental leave.

What you’ll do

• Serve as a Data Engineer on a cross-functional team to help address pressing problems
• Integrate data, transform insights, and build applications that support operational decisions
• Set up transfers of data feeds from source systems into a target location
• Write transformations and derive new datasets using Spark for distributed computation
• Monitor build progress and debug issues that arise during data builds
• Design applications that answer operational questions using platform data
• Execute requests for information (RFI’s) related to the platform’s data footprint
• Work with product teams while debugging and understanding the code powering the platform

What you bring

• BS in Computer Science / Engineering (or related career field) preferred
• Strong Data Engineering background
• Experience with Spark, Pyspark, and/or Pandas
• Extensive coding and programming experience in Python
• Extensive coding and programming experience in SQL, R, or similar
• Strong understanding of algorithms and data structures as they apply to development
• Experience with Foundry preferred
• Active Secret Security Clearance (required)

Technologies: Spark, Pyspark, Pandas, Python, SQL, R, Foundry

Experience expectations

• Data engineering: 5 years (preferred)
• Python coding/programming: 5 years (preferred)
• Building and managing data pipelines: 5 years (preferred)
• Data transformation: 5 years (preferred)
• Foundry: 1 year (preferred)
• Spark and/or Pyspark: 3 years (preferred)
• Pandas: 3 years (preferred)

Benefits

• 401(k) and 401(k) matching
• Dental insurance
• Flexible schedule
• Flexible spending account
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Parental leave
• Professional development assistance
• Relocation assistance
• Retirement plan
• Tuition reimbursement
• Vision insurance

Job type: Full-time
Work location: In person
Salary: USD 175,000 - 260,000 per year
Security clearance: Secret (required)