Data & Analytics Senior Data Engineer

Senior Data Engineer with a focus on data engineering and AI/LLM initiatives within a leading strategy consultancy, collaborating with the Data Science & Engineering team to build pipelines, platforms, and client-facing analytics.

Responsibilities

• Lead end-to-end data engineering and AI/ML projects from concept through deployment in client cloud environments, prioritizing scalability, performance, and reliability
• Design and deliver data pipelines, data models, and infrastructure that support analytical and AI solutions for client use cases
• Assist clients in defining data and AI strategies, translating business goals into actionable technical roadmaps and governance frameworks
• Contribute to agentic AI engagements by designing multi-agent architectures and automation workflows that yield measurable client outcomes
• Support technology due diligence, evaluating data infrastructure, AI/ML capabilities, engineering practices, and technical risks of target organizations
• Interpret analytical outputs and help integrate data-driven insights into clients' business workflows
• Collaborate with Managing Directors to scope and draft client proposals where data engineering and AI are central to delivery
• Serve as the technical interface among the Data Science & Engineering team, consulting partners, and clients to ensure alignment on fit and delivery expectations
• Translate technical requirements and constraints into clear, actionable language for client-facing presentations and proposals
• Support the design and commercialization of new offerings in data strategy, AI strategy, agentic AI, and LLM-powered analytics
• Contribute to internal enablement by keeping leadership informed about current data strategy and AI capabilities
• Drive scalable, production-grade data pipelines and ETL/ELT processes feeding proprietary analytics products and client tools
• Build and maintain cloud data infrastructure, including warehouses, data lakes, and data models for internal and bespoke client solutions
• Develop AI-powered analytical applications utilizing LLMs, RAG architectures, and ML techniques to address complex client problems
• Promote best-in-class engineering practices in data quality, CI/CD, containerization, and scalable architecture across IP assets
• Stay current with data engineering tooling, cloud platforms, and AI/LLM frameworks; contribute to the D&A technical roadmap and standards
• Identify new use cases where data infrastructure or AI can deliver outsized client value or strengthen internal capabilities
• Collaborate with data scientists, product owners, and consulting stakeholders to continuously innovate on apps and proprietary data assets

Requirements

• 4+ years of applied data engineering experience with a track record of delivering scalable, production-grade data solutions
• Strong data modeling, ETL/ELT pipeline design, and experience with large-scale structured and unstructured datasets
• Proficiency in Python and SQL; experience with PySpark, Apache Airflow; familiarity with Spark or Scala
• Hands-on experience deploying data solutions on Azure (preferred) or another major cloud (AWS, GCP); familiarity with on-prem Microsoft SQL Server
• Experience with APIs (FastAPI), containerization (Docker, Kubernetes), DevOps practices, Git, and CI/CD
• Experience with Microsoft Fabric across multiple workloads (Data Factory, Lakehouse, semantic models, Power BI)
• Familiarity with building and deploying cloud-based analytics web applications is preferred
• Experience with cloud data warehouses and data lake architectures (Snowflake, BigQuery, Redshift) is preferred
• Hands-on development and deployment of LLM-based applications in production, including RAG pipelines, prompt engineering, and LLM evaluation
• Experience designing agentic AI systems (multi-agent orchestration or automation workflows) using LangChain or equivalent
• Familiarity with at least one major cloud AI platform (Microsoft Foundry, AWS Bedrock, or GCP Vertex AI) and associated deployment patterns
• Knowledge of LLM evaluation frameworks (e.g., Ragas, LangSmith) and retrieval quality assessment is preferred
• Experience with core agentic AI and LLM libraries (Transformers, LangGraph, Pydantic AI) in production settings is preferred
• Ability to translate requirements for technical and non-technical audiences while collaborating with data science, engineering, and consulting teams
• Prior experience in strategic consulting is preferred; exposure to sectors such as life sciences, healthcare, consumer, industrials, or TMT is a plus
• Strong problem-solving capabilities and comfort working in a fast-paced, entrepreneurial environment with ownership

Technologies

• Python
• SQL
• PySpark
• Apache Airflow
• Spark
• Scala
• Azure
• AWS
• GCP
• Microsoft SQL Server
• FastAPI
• Docker
• Kubernetes
• Git
• CI/CD
• Microsoft Fabric
• Data Factory
• Lakehouse
• Power BI
• Snowflake
• BigQuery
• Redshift
• LangChain
• LangSmith
• Transformers
• LangGraph
• Pydantic AI
• Microsoft Foundry
• AWS Bedrock
• GCP Vertex AI
• RAG

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• Life insurance
• Disability insurance
• 401(k) with employer contribution
• HSA contributions
• Paid time off
• Other firm-sponsored benefits

Location

• Boston, MA
• Chicago, IL
• Los Angeles, CA
• New York, NY
• San Francisco, CA

Why join

• Help grow a data driven capability within a top tier strategy consultancy
• Collaborate with C-suite clients and life sciences innovators to deliver market-shaping insights
• Play a leadership role in the firm’s evolving Data & Analytics and digital solutions strategy
• Join a supportive, entrepreneurial team with access to cutting-edge tools and professional development

Additional information

• The base salary is $135,000 annually. Compensation may vary by experience, qualifications, skills, and location, and discretionary bonus and comprehensive benefits may apply.
• Offers a competitive total rewards package including medical, dental, vision, life and disability insurance, 401(k) with employer contribution, HSA contributions, paid time off, and other firm-sponsored benefits.
• This role is based in Boston, Chicago, Los Angeles, New York, or San Francisco with a hybrid schedule requiring in-office presence Tuesday through Thursday and the first Friday of each month.
• Applicants must be legally authorized to work in the United States on a permanent basis without employer sponsorship. Visa sponsorship is not available.
• L.E.K. Consulting is an Equal Opportunity Employer and provides reasonable accommodations for qualified individuals with disabilities or religious beliefs as required by law.
• For more information and to apply, please visit the firm’s careers site.
• #LI-DE1