EngineerJobs.io
← Back to all jobs
D2 Technologies

Data Engineer

D2 Technologies
Herndon, VA $100k - $150k/yr Full time Posted 2d ago
Big Data Bigdata Cloud Data Engineering Cloud Data Platform Cloud Platform Cloud Platforms Data Data Analysis Data Analytics Data Architecture Data Engineer Data Engineering Data Governance Data Integration Data Integration Tools Data Lakehouse Data Management Data Pipeline Data Platform Data Processing Data Security Data Warehouse Database Databases Databricks Databricks Dlt Databricks Lakehouse ETL Informatica Pyspark Spark SQL
Apply Now

Job Description

D2 Technologies is building enterprise-scale data capabilities and is seeking an experienced Data Engineer to design, develop, and optimize data solutions on the Databricks Lakehouse Platform. This hybrid role in Herndon, VA supports large-volume data processing through scalable ETL/ELT pipelines and performance-focused analytics engineering using Apache Spark and SQL.

What You’ll Do

  • Design, develop, and maintain scalable data engineering solutions using Databricks and Apache Spark
  • Build and optimize high-performance ETL/ELT pipelines for both structured and unstructured data
  • Develop, tune, and optimize complex SQL queries for data transformation and analytics
  • Translate business requirements into scalable technical solutions
  • Troubleshoot production issues and optimize data pipeline performance
  • Ensure data quality, integrity, security, and governance across enterprise data platforms
  • Collaborate with data architects, software engineers, analysts, and business stakeholders
  • Participate in code reviews and follow software engineering best practices
  • Create and maintain technical documentation for solutions, deployments, and operational support
  • Support production releases and provide operational support as needed

What You Bring

  • U.S. Citizenship is required
  • Top Secret (TS) Security Clearance or Public Trust Clearance preferred
  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field (or equivalent experience)
  • Hands-on experience developing and implementing data engineering solutions using Databricks
  • Strong, hands-on experience with the Databricks Lakehouse Platform
  • Strong programming experience with Apache Spark (PySpark/Spark SQL)
  • Expert-level SQL skills, including writing, optimizing, and troubleshooting complex queries
  • Strong analytical, critical thinking, and problem-solving skills
  • Experience designing, developing, and supporting ETL/ELT pipelines
  • Strong understanding of data modeling, data warehousing, and Delta Lake
  • Experience using Git or other version control systems
  • Excellent verbal and written communication skills

Additional Preferred Qualifications

  • Experience with Azure, AWS, or Google Cloud Platform
  • Knowledge of CI/CD pipelines and DevOps practices
  • Experience with Databricks Delta Live Tables (DLT) and Unity Catalog
  • Nice to have: PL/SQL

Technologies: Databricks, Databricks Lakehouse Platform, Apache Spark, PySpark, Spark SQL, SQL, ETL, ELT, Delta Lake, Git, Azure, AWS, Google Cloud Platform, Databricks Delta Live Tables (DLT), Unity Catalog, PL/SQL, CI/CD

Location: Hybrid remote in Herndon, VA 20192
Salary: $100,000 - $150,000 per year (negotiable)

Application screening: Federal Project requires US Citizenship. Are you US Citizen?

Similar Jobs