ETL Data Engineer

NFF Inc is hiring an ETL Data Engineer for onsite work in Washington, DC to support the Enterprise Data team with data curation, processing, and transformation.

Responsibilities

• Analyze, design, develop, implement, replicate, and support complex enterprise data initiatives
• Interface with other agencies; gather input from stakeholders and consult user departments on system requirements
• Advise on environment constraints and operating difficulties in the current state, then help identify and resolve issues using cloud solutions
• Gather requirements by reviewing existing code and documentation, then deliver enhancements and new development for District data systems
• Build and maintain end-to-end ETL pipelines that extract from multiple sources or source systems and load into landing layers or SQL tables
• Establish cloud and on-prem connectivity across systems including ADLS, ADF, and Synapse, and support data movement workflows
• Develop and optimize data workflow and pipeline processes in line with best practices
• Create, standardize, and run data pipeline automation, monitoring, and alerting
• Support enterprise data governance by helping ensure data accuracy, consistency, security, and reliability
• Evaluate proposed system changes for feasibility and recommend alternative approaches, along with backup and rollback procedures
• Participate in development of new systems, upgrades, and enhancements; ensure implementations align to approved standards
• Develop complex programs and reports using database query languages
• Support data visualization efforts through relevant tools
• Handle and secure sensitive data according to its level of sensitivity

Requirements

• Bachelor’s degree in Information Technology or related field, or equivalent experience
• 15 years strong knowledge of Extract-Transform-Load (ETL) processes, including end-to-end pipelines with data loading from multiple sources
• 15 years ability to gather and document requirements for data extraction, transformation, and load processes
• 15 years understanding of data warehousing, data lake, business intelligence, and information management concepts and standards
• 15 years ability to advise internal and external customers on tools and systems for complex data processing challenges
• 15 years knowledge and use of SQL for relational databases
• 11 years experience with data formats including database-specific (Oracle, SQL Server, DB2, Quickbase), text formats (CSV, XML), and binary formats (Parquet, AVRO)
• 11 years contribute to enterprise data governance standards (accuracy, consistency, security, reliability)
• 7 years strong experience with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, and Blob Storage (required 5 years)
• 5 years experience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow, and FME
• 5 years experience with visualization and reporting software such as MicroStrategy, Tableau, and Esri ArcGIS
• Highly desired 3 years communication skills (oral and written)
• Required 3 years ability to provide excellent customer service to external partners
• Required 3 years ability to work independently or as part of a larger team
• Highly desired 3 years experience performing data functions with Databricks

Technologies

• Azure Data Factory (ADF), Azure Synapse, Databricks, Informatica
• MSSQL Db, Azure SQL DB
• Azure Data Lake Storage Gen2 (ADLS), Blob Storage
• Python
• ADLS, ADF, Synapse
• Informatica PowerCenter, Apache NiFi, Apache Airflow, FME
• Oracle, SQL Server, DB2, Quickbase
• CSV, XML, Parquet, AVRO
• SQL, Postgres
• MicroStrategy, Tableau, Esri ArcGIS

Salary and Location

• Location: Washington, DC (onsite)
• Salary: USD 100,000 - 125,000 per year

Benefits

• Medical, Dental and Vision
• Health Savings Account
• Flexible Spending Account
• STD, LTD, Supplemental life insurance and ADD&D
• Comprehensive 401k plan
• Paid Time Off