Collaboredge Inc. is hiring an ETL Data Engineer for the Enterprise Data team supporting OCTO’s Cloud Data Exchange. This contract role is based in Washington, DC (onsite) and focuses on building reliable, governed data pipelines using native Azure tooling for ETL, loading, and transformation. You will support end-to-end data curation, processing, and transformation work for complex enterprise initiatives, including automation, monitoring, and pipeline governance.
Responsibilities
- Analyze, design, develop, implement, replicate, and support complex enterprise data projects.
- Interface with other agencies and consult with user departments on system requirements, including advising on environment constraints and operational challenges in the current state.
- Develop and replicate future enhancements to district data systems, including implementing cloud solutions to advise, resolve issues, and improve pipelines.
- Apply strong ETL expertise using frameworks such as Azure Data Factory, Synapse, Databricks, and Informatica, gathering requirements from stakeholders or analyzing existing code for enhancements and new development.
- Establish cloud and on-premise connectivity across systems such as ADLS, ADF, Synapse, and Databricks.
- Build and support hands-on ETL and data workflows in Azure, including Azure Data Factory or Azure Synapse, MSSQL (as applicable), Azure SQL Database, Azure Data Lake Storage Gen2, Blob Storage, and Python.
- Create end-to-end pipelines that load data from multiple sources into a landing layer and/or SQL tables.
- Use and integrate data pipeline tools such as Informatica, Synapse, Apache NiFi, and Apache Airflow.
- Work with multiple data formats, including database-specific formats (Oracle, SQL Server, DB2, Quickbase), text formats (CSV, XML), and binary formats (Parquet, AVRO).
- Standardize and optimize existing data workflows/pipelines while adhering to best practices.
- Support enterprise data governance by ensuring data accuracy, consistency, security, and reliability.
- Automate, monitor, alert, and manage data pipelines and workflows.
- Analyze and evaluate system changes for feasibility, and provide alternative solutions along with backup and rollback procedures.
- Develop complex programs and reports using database query languages, and work with data visualization tools as needed.
- Handle and secure sensitive data in alignment with its sensitivity level.
Requirements
- Strong ETL knowledge, including end-to-end pipelines with data loading from multiple sources.
- Ability to gather and document requirements for data extraction, transformation, and load processes.
- Understanding of data warehousing, data lake, business intelligence, and information management concepts and standards.
- Ability to advise internal and external customers on appropriate tools and systems for complex data processing challenges.
- Knowledge and use of SQL for relational databases.
- Experience with data formats including database-specific (Oracle, SQL Server, Postgres, DB2), text (CSV, XML), and binary (Parquet, AVRO).
- Ability to contribute to enterprise data governance through accuracy, consistency, security, and reliability.
- Strong experience with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, and Blob Storage.
- Experience with data integration and pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow, and FME.
- Strong communication skills (oral and written), and ability to provide excellent customer service to external partners.
- Ability to work independently or as part of a larger team.
Technologies
Azure Data Factory, Azure Synapse, Databricks, Informatica, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python, ADLS, ADF, SQL, Oracle, SQL Server, DB2, Quickbase, CSV, XML, Parquet, AVRO, Informatica PowerCenter, Apache NiFi, Apache Airflow, FME, MicroStrategy, Tableau, Esri ArcGIS.
Education
Bachelor’s degree in Information Technology or related field, or equivalent experience.
Background Check
- Extensive criminal history background check will be required.
- Candidates cannot be submitted with recent histories (going back seven years) involving extensive driving, drug, robbery, or any other illegal activity.
- Any criminal activity on the background check will eliminate the candidate from consideration.
- If selected, candidates must complete this criminal background check prior to starting.
- NATIONAL background checks are required; Federal background checks are not compliant under this contract.
- A national background check is a national criminal background check that pulls criminal records from State and County Courts in almost every US State.
Location: Washington, DC (onsite)
Salary: USD 59–72 per hour
Experience: Minimum 3 years
Job type: Contract
