Azure Data Engineer
Big Data
Cloud Data Engineering
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Informatica
Information Technology (IT)
Integration
Programming
Programming Language
Programming Languages
Software Development
SQL
Job Description
Robotics Technologies is seeking an Azure Data Engineer in Raleigh, NC (onsite) to design, build, and operate scalable cloud data pipelines and solutions on Microsoft Azure. This role focuses on modern data engineering across ETL/ELT, processing, warehousing, lake and lakehouse architectures, governance, and production monitoring. The hourly salary range is USD 78 - 78.
What you’ll do
- Design, develop, and maintain scalable data pipelines using Azure data services.
- Build and optimize ETL/ELT workflows with Azure Data Factory (ADF).
- Develop data processing solutions using Azure Databricks with PySpark and Apache Spark.
- Use Azure Synapse Analytics for data warehousing and analytical workloads.
- Create complex SQL queries and stored procedures, including performance optimization.
- Implement data lake and lakehouse architectures with Azure Data Lake Storage Gen2.
- Integrate data from multiple sources such as relational databases, APIs, and cloud platforms.
- Establish data quality practices, including validation, transformation, and governance processes.
- Develop and maintain both batch and real-time data processing solutions.
- Optimize pipelines for performance, scalability, and cost efficiency.
- Implement monitoring, logging, and error-handling mechanisms for reliable operations.
- Partner with data architects, analysts, and business stakeholders to deliver data solutions.
- Apply security best practices for data access, encryption, and compliance.
What you’ll bring
- Experience with Microsoft Azure for end-to-end data engineering solutions.
- Hands-on knowledge of Azure Data Factory (ADF) for data integration.
- Strong big data and distributed processing skills using Azure Databricks, Apache Spark, and PySpark.
- Working knowledge of Azure Synapse Analytics for warehousing and analytics.
- Experience building lake and lakehouse solutions with Azure Data Lake Storage Gen2.
- Proficiency in Python and SQL (including Azure SQL Database and SQL Server).
- Familiarity with Lakehouse, Delta Lake, and Medallion Architecture.
- DevOps experience with Azure DevOps, Git, and CI/CD.
- Understanding of data governance using Microsoft Purview.
- Streaming experience with Azure Event Hubs and Stream Analytics.