Cloud Data Engineer
Job Description
S&N Infrastructure is seeking a Cloud Data Engineer to design, build, and support Azure data pipelines and Power BI solutions for an ERP cloud migration. This hybrid role in Louisa, Virginia, emphasizes reliable data infrastructure, scalable semantic models, and executive-ready reporting to empower leadership with trustworthy analytics. The successful candidate will own data ingestion, transformation, storage, and orchestration while collaborating with stakeholders to turn business questions into meaningful insights.
Responsibilities
- Build and scale the cloud data foundation that powers enterprise reporting and analytics.
- Design and manage robust data pipelines connecting ERP and business-critical systems, with a focus on reliability, maintainability, and performance.
- Own data ingestion, transformation, storage, and orchestration across the platform.
- Keep the environment reliable, high-performing, and ready to grow with the business.
- Serve as a key technical contributor on the ERP cloud migration.
- Lead administration and evolution of the Power BI environment, including workspace structure, deployment standards, security, and performance optimization.
- Build, optimize, and maintain datasets, dataflows, models, and business-critical reports.
- Partner with stakeholders to turn reporting needs into actionable insights.
- Establish scalable semantic models, DAX measures, and data layers that support better decisions.
- Maintain governance standards and secure user access across the Power BI environment.
- Set the standard for data quality, consistency, and trust across the platform.
- Build and maintain data dictionaries, lineage documentation, and metadata that scale with the organization.
- Monitor platform health, resolve issues quickly, and implement proactive alerting.
- Partner with business teams to improve data accuracy and confidence in reporting.
- Work directly with business leaders to understand priorities and shape reporting solutions that matter.
- Translate business questions into intuitive data models, dashboards, and visual insights.
- Enable adoption through training, guidance, and documentation for Power BI users.
- Collaborate with software development and IT teams on application and integration data needs.
- Help guide data-related priorities and roadmap discussions alongside IT leadership.
Requirements
- Hands-on experience with Microsoft Azure β Azure Data Factory, Azure Data Lake Gen2, and Azure Synapse Analytics (serverless SQL).
- Configuring, deploying, and monitoring Self-Hosted Integration Runtime (SHIR), including heartbeat alerting.
- Strong knowledge of Change Data Capture (CDC) on SQL Server for near real-time inserts, updates, and deletes.
- Proven experience building and supporting ADF incremental pipeline patterns in production, including LSN watermark logic from on-premises SQL to Azure.
- Familiarity with Delta Parquet / Delta Lake architecture, including raw-to-curated layer design.
- Building unified analytical views with Azure Synapse serverless SQL.
- Deep Power BI experience across administration and development β DirectQuery, composite models, governance, datasets, dataflows, DAX, and semantic layers.
- Platform monitoring with Azure Monitor, SQL Agent alerts, SHIR heartbeat, and Power BI freshness dashboards.
- Strong ETL / ELT pipeline development with ADF, including incremental loads, watermarking, and orchestration.
- Advanced SQL and T-SQL for data modeling, transformation logic, and cross-database analytics.
- Implementing and managing Change Data Capture (CDC) on SQL Server 2016+.
- Designing data lake architectures using raw-to-curated Delta format patterns.
- Python or PySpark for data processing and transformation.
- Integrating ERP data into reporting and analytics environments.
- 5+ years in data engineering / BI development.
- Able to operate independently, make sound technical decisions, and own critical deliverables with limited oversight.
- Comfortable working in a growing, multi-entity environment with evolving priorities.
- dbt (data build tool) or other SQL-based transformation framework experience in a modern analytics stack.
- Azure DevOps and CI/CD experience for data pipelines, release management, and environment promotion.
- Implementing Power BI governance standards, deployment pipelines, row-level security, and usage monitoring.
- Microsoft Fabric, Power Automate, or broader Azure ecosystem experience.
- Experience in acquisition-heavy, multi-entity, or fast-scaling organizations with complex reporting needs.
- Prior experience supporting ERP modernization, cloud migration, or enterprise reporting transformation.
Technologies
- Azure Data Factory
- Azure Data Lake Gen2
- Azure Synapse Analytics (serverless SQL)
- Self-Hosted Integration Runtime (SHIR)
- Change Data Capture (CDC) on SQL Server
- Delta Parquet
- Delta Lake
- Azure Synapse serverless SQL
- Power BI
- DirectQuery
- DAX
- Dataflows
- SQL Server
- Python
- PySpark
- dbt
- Azure DevOps
- Microsoft Fabric
- Power Automate
- SQL Agent
- Azure Monitor
Benefits
- 401(k)
- 401(k) matching
- Dental insurance
- Health insurance
- Life insurance
- Paid time off
- Vision insurance
Compensation
Salary: USD 95,000 per year
Location
Hybrid remote in Louisa, VA 23093