Azure Data Engineer
Backend Developer
Python
Analytics
Azure
Azure Data Engineer
Azure Data Factory
Azure Data Lake
Azure Data Platform
Azure DevOps
Big Data
Bigdata
Business Analytics
Business Intelligence
CI/CD
Cloud
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Factory
Data Factory Azure
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Visualization
Data Warehouse
Database
Databases
Databricks
DevOps
Devops Tools
Digital Marketing
ETL
Informatica
Microsoft
Microsoft Azure
Power BI
Power Platform
Pyspark
Reporting and Analytics
Software Development
Spark
SQL
Visual Design
Job Description
NSD International, Inc. is hiring an Azure Data Engineer to support ongoing development of an Azure-based data platform, starting with reference data for securities and pricing.
- Develop and enhance an Azure data platform in close coordination with the team
- Start with implementation of a reference data system for securities and pricing data
- Extend to additional data domains after initial reference data capabilities are established
- Follow internal development standards to align contributions with the Data Strategy team agenda
- Implement Azure-based solutions using the technologies listed in the qualifications
Requirements
- 10+ years of software development experience using Python, PySpark, and associated frameworks
- Proven experience as a Data Engineer and/or Data Quality Engineer with Azure cloud experience
- Experience implementing solutions using Azure cloud services
- Experience implementing solutions using Azure Data Factory
- Experience implementing solutions using Azure Lake Gen 2
- Experience implementing solutions using Azure Databases
- Experience implementing solutions using Azure Databricks
- Experience implementing solutions using a Data Quality Framework/Solution
- Experience implementing solutions using Collibra Data Quality or data quality tools such as IDQ, IBM, or Ab-Initio
- Experience implementing solutions using Collibra Data Governance with knowledge of data lineage
- Experience implementing solutions using Power BI
- Well versed with Azure Databricks
- Strong SQL skills with RDBMS or noSQL databases
- Familiarity with the DevOps lifecycle including git and Jenkins
- Experience with CI/CD processes
- Good understanding of ETL/ELT processes
- Financial services industry experience is a plus, including knowledge of financial instruments, asset classes, and market data
Technologies
- Python, PySpark
- Azure cloud services
- Azure Data Factory
- Azure Lake Gen 2
- Azure Databases
- Azure Databricks
- Data Quality Framework/Solution
- Collibra Data Quality, IDQ, IBM, Ab-Initio
- Collibra Data Governance, Data lineage
- Power BI
- SQL, RDBMS, noSQL
- DevOps lifecycle: git, Jenkins, CI/CD processes
- ETL, ELT
Benefits
- 401(k) matching
- Dental insurance
- Health insurance
- Vision insurance
- Job type: Contract
- Term: 1 year (possibility of extension)
- Salary: USD $74.00 per hour
- Expected hours: 35.0–45.0 per week
- Location: Hybrid remote in Charlotte, NC 28202
- Minimum experience: 10 years