Data Engineer II

Lewis Energy Group is hiring a Data Engineer II to help build and support an enterprise data platform on Microsoft Fabric in an onsite role based in San Antonio, TX. You will work with a modern analytics environment and support reliable reporting by designing pipelines, transformations, and semantic models that keep data accurate and accessible.

In this position, you will partner with technical and business stakeholders while delivering data foundation work that improves performance, refresh reliability, and data governance. The role includes hands-on migration support from existing SQL Server and legacy ETL processes to Fabric-native solutions.

What you’ll do

• Design, build, and maintain data pipelines in Microsoft Fabric using Data Factory pipelines, Dataflows Gen2, and notebooks to load data into Lakehouses and Warehouses.
• Develop data transformation and processing logic using Python and PySpark within Fabric notebooks, including work with Delta tables and large or complex datasets.
• Write and optimize T-SQL using stored procedures, views, and transformation logic that supports processing and reporting needs.
• Apply modeling approaches such as medallion architecture and star schema design to organize data in OneLake for performance and usability.
• Monitor pipeline runs, troubleshoot failures, and implement alerting, error handling, and delivery controls so data reaches users on time and accurately.
• Assess on-premises systems including SQL Server databases, SSIS packages, and scheduled jobs to plan migrations to Microsoft Fabric.
• Rebuild or refactor legacy ETL as Fabric-native pipelines and PySpark notebooks to improve maintainability and performance.
• Coordinate with stakeholders on migration timelines to minimize disruption to reporting and operations.
• Build and maintain Power BI semantic models, including relationships, measures, ontology, and Direct Lake or Import configurations.
• Work with report developers and business users to translate reporting requirements into well-structured datasets.
• Tune data models and queries to improve report performance and refresh reliability.
• Communicate technical concepts, data limitations, and project status clearly to non-technical stakeholders.
• Implement data quality checks and validation rules to detect issues before they reach end users.
• Manage Fabric workspace organization, access permissions, and security settings aligned with company data governance standards.
• Use source control (Azure DevOps/Git) and deployment pipelines to manage changes across development, test, and production environments.
• Create and maintain documentation for data sources, pipelines, models, dictionaries, and business logic.

What you’ll bring

• Demonstrated ability to design relational and dimensional data models, including fact and dimension tables, keys, relationships, referential integrity, and historical changes.
• Strong T-SQL skills for complex joins, transformations, query tuning, and troubleshooting.
• Hands-on experience integrating across databases, APIs, or file-based sources, including scheduling, incremental processing, and recovery.
• Ability to validate data completeness and accuracy, reconcile source and target results, and investigate duplicates and broken relationships.
• Experience using Python or a comparable scripting language for data processing or automation, plus version control practices.
• Ability to translate business requirements into documented models and clearly explain technical decisions; willingness to learn unfamiliar platforms.

Tech you’ll use

• Microsoft Fabric, Data Factory, Dataflows Gen2, PySpark, Python, T-SQL
• SQL Server, SSIS, OneLake, Lakehouses, Warehouses, Delta
• Power BI, Power Query, DAX, SSAS
• Azure Data Lake Storage, Azure SQL, Synapse Analytics, Databricks
• Azure DevOps, Azure Git

Benefits

• Medical/Dental/Vision plus Basic Life and AD&D, and other benefit options
• 401K with immediate matching contribution
• Annual Discretionary Bonus
• Generous Paid Time Off and paid holidays
• Employee Assistance Program (EAP) for you and your dependents (free, confidential support)
• Wellness & Company Events throughout the year

Location and schedule

Onsite in San Antonio, TX. Candidates must be able to work full-time from the San Antonio office.

Minimum experience: 2 years. Education: Bachelor’s degree from a four-year college or university.

Preferred experience: Power BI semantic models, Power Query, DAX, or comparable business intelligence tools; Microsoft SQL Server, SSIS, SSAS, or comparable database and integration technologies; Microsoft Fabric and related Azure technologies; oil and gas production data, SCADA, telemetry, time-series data, IoT, or streaming data.