Sr. AI & Data Engineer–Trading Analytics

Shell Energy offers a hybrid, Houston-based role with a compelling compensation package and a culture built on practical, data-driven impact. You will work on AI driven analytics that empower front office traders, leveraging Databricks data engineering and GenAI workflows. Expect a collaborative environment that prioritizes governance, measurable outcomes, and ongoing learning, with flexible hours and the option for remote or mobile work.

This Senior AI and Data Engineer role focuses on designing and productionizing analytics for trading teams. You will translate complex business questions into clear analytical problems, deliver scalable data infrastructure, and advance GenAI and agent-based solutions that support decision making in real time.

Responsibilities

• Design, build, and deliver AI driven analytics for traders and analysts, including seasonality analysis, correlation studies, regression models, forecasting, and scenario modeling over market pricing and fundamentals data
• Collaborate with traders and analysts to transform ambiguous business questions into well-defined analytical problems and solutions
• Communicate analytical outputs and AI generated insights to commercial stakeholders in a concise, actionable way
• Develop and maintain scalable data pipelines on Databricks using PySpark/Spark, SQL, Delta Lake, and Unity Catalog
• Ingest, model, and transform large scale time series pricing and fundamentals datasets
• Optimize pipelines for performance, reliability, and cost, ensuring adherence to platform governance standards
• Build and enhance GenAI and agent based solutions to support trading analytics, including Retrieval Augmented Generation, prompt engineering, and agent orchestration with LangGraph
• Implement tool calling and guardrails, integrating LLM workflows with structured market data for enhanced analysis
• Prototype quickly, collect user feedback, and harden selected use cases for production deployment
• Contribute to production ready analytics with testing, documentation, versioning, and basic observability
• Follow CI/CD and DevOps practices, including Git based workflows and automated testing
• Support governance requirements such as PII handling, data lineage, and auditability in line with Trading & Supply standards

Requirements

• Must have legal authorization to work in the US on a full-time basis for anyone other than the current employer
• Bachelor’s degree or equivalent relevant experience
• At least 10 years of relevant experience
• Hands on experience with Databricks and/or Spark (PySpark, SQL, Delta Lake; Unity Catalog desirable)
• Proven data engineering skills, including pipeline development, data modeling, and performance optimization
• Strong foundation in statistics, econometrics, or data science, with experience applying these techniques to time series or market style datasets
• Experience building or contributing to LLM based solutions, including prompt engineering and retrieval based approaches
• Familiarity with GenAI frameworks and tooling (for example LangGraph or similar orchestration patterns)
• Experience working in collaborative engineering teams using Git and CI/CD pipelines
• Strong communication skills and the ability to work directly with analysts, traders, and other business stakeholders
• Exposure to commodity or financial trading environments
• Understanding of market fundamentals, supply demand dynamics, or risk concepts
• Experience with MLflow, feature stores, or vector databases
• Familiarity with working in regulated or risk sensitive environments

Technologies

• Databricks, PySpark, Spark
• SQL, Delta Lake, Unity Catalog
• LangGraph, Git, CI/CD
• MLflow

What we offer

• Base salary range of $149,000 to $223,000 per year
• Health insurance options including medical, dental, and vision
• Life Insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs
• Pension plan and 401(k) plan
• Paid leave: up to 6 weeks vacation and up to 11 holidays
• Parental leave: 16 weeks for birthing parents, 8 weeks for non birthing parents
• Short term disability up to 26 weeks at 100% or 50% of base pay; Long term disability
• Adoption, wellness, education, and personal learning expense reimbursements
• Discretionary long term incentives
• Intern benefits include medical, dental, vision, life insurance, Business Travel Accident Insurance, Occupational Accidental Death Benefit programs, 401(k), and paid holidays
• Flexible working hours and the possibility of remote or mobile working