EngineerJobs.io
← Back to all jobs

Job Description

MSR Cosmos is hiring a Data Engineer / Lead Data Engineer for a hybrid role based in Houston, TX. In this position, you will help establish data foundations and deliver end-to-end analytics capabilities within a complex energy trading environment, partnering across teams to turn business needs into production-grade data solutions on Microsoft Azure.

The role combines hands-on engineering across ingestion, transformation, and data modeling with leadership over delivery, quality controls, and reusable patterns. You will also develop dashboards and reporting that stakeholders can use for accessible, actionable insights.

Responsibilities

  • Lead the design and development of scalable data ingestion and transformation pipelines using standard data lake and cloud engineering frameworks.
  • Build solutions handling structured and unstructured data in high-volume, high-velocity, high-variety environments.
  • Create transformation notebooks, physical and tabular data models, data endpoints, semantic layers, and effective visualisations.
  • Deliver reusable data products that improve accessibility, consistency, and business value.
  • Lead ETL/ELT activities across source systems, data platforms, and downstream business intelligence solutions.
  • Create and publish dashboards and reports that provide stakeholders with accessible, actionable information.
  • Perform trend and correlation analysis, identify data discrepancies, and implement controls to protect data quality across platforms.
  • Define and enforce engineering standards, reusable patterns, documentation, and development practices.
  • Build automated continuous integration and release pipelines and apply disciplined source-control practices.
  • Gather functional and non-functional requirements, translate features and Product Backlog Items into technical designs, and establish delivery direction.
  • Collaborate with cross-functional teams in a dynamic business environment and mentor engineers where required.

Requirements

  • Demonstrable data engineering experience within energy trading, commodities trading, or an ETR M/CTR M environment. This is mandatory.
  • Strong hands-on experience designing production-grade ingestion, storage, transformation, modelling, and serving layers on Microsoft Azure.
  • Advanced SQL capability, including development and optimisation of complex queries for transformation and analysis.
  • Hands-on experience with Azure Data Factory, Azure SQL, Azure Databricks, Azure Blob Storage, and Azure Data Lake Storage.
  • Strong ETL/ELT and data warehousing experience, including delivery of business intelligence solutions.
  • Experience with dimensional, physical, and tabular data modelling and performance optimisation.
  • Experience with GitHub and/or Azure DevOps, including automated build, test, and release pipelines.
  • Ability to gather requirements, shape technical solutions, and communicate clearly with technical and business stakeholders.
  • Proven ability to lead workstreams, manage priorities, and deliver effectively in a collaborative team environment.

Technologies

  • SQL
  • Microsoft Azure
  • Azure Data Factory
  • Azure SQL
  • Azure Databricks
  • Azure Blob Storage
  • Azure Data Lake Storage
  • GitHub
  • Azure DevOps

Preferred Experience

  • Experience with dbt, Azure Analysis Services, Azure Table Storage, and Azure Logic Apps.
  • Experience with Power BI and the design of clear, decision-oriented dashboards and reports.
  • Exposure to Power Apps and broader Microsoft Power Platform capabilities.
  • Familiarity with IBM DataStage or comparable enterprise integration tooling.
  • Basic understanding of AI engineering, including how governed data products support analytics and AI use cases.
  • Knowledge of data governance, lineage, metadata management, observability, and automated data-quality controls.

Location: Houston, TX (hybrid) | Salary: USD 65 - 70 per hour

Similar Jobs