F
Lead Data Engineer / Architect
Artificial Intelligence
Big Data
Bigdata
Data
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Lakehouse
Data Pipeline
Data Processing
Databricks
Databricks Lakehouse
Databricks Lakehouse Platform
Lead Ai Engineer
Lead Data Engineering
Llm Operations
Programming Languages
Rag Architectures
Software Development
SQL
Job Description
Hybrid, hands-on role with a flexible schedule in Cary, NC. From Day 1, you will work onsite Tuesday–Thursday while partnering remotely the rest of the week. This is a production-focused Lead Data Engineer / Architect position at Fasiokart, blending enterprise data platform engineering with delivery of production AI and LLM capabilities (including LLM/RAG).
What you’ll do
- Design solutions and deliver production code, including reviewing work and guiding data engineering teams through technical decisions.
- Build and deploy LLM-based solutions end to end, covering RAG, embeddings, retrieval approaches, and prompt engineering.
- Design and implement lakehouse / medallion architecture using Bronze, Silver, and Gold layers at enterprise scale.
- Engineer metadata-driven ingestion and transformation frameworks, with a focus on data quality and large-scale pipeline optimization.
What you’ll bring
- Strong production data engineering skills in Python, PySpark, Scala, and SQL.
- Enterprise experience with Azure Databricks, including Delta Lake, Spark performance tuning, Jobs/Workflows, and Unity Catalog.
- Azure data services expertise, including ADLS Gen2 and Azure Data Factory (ADF).
- Proven implementation of lakehouse / medallion patterns with Bronze, Silver, and Gold layers at enterprise scale.
- Hands-on production AI/LLM delivery experience, including RAG, embeddings, retrieval, and prompt engineering.
- Experience with LLM frameworks such as LangChain, LlamaIndex, or LangGraph, plus Azure OpenAI, OpenAI, or Databricks Model Serving.
- Automation and deployment experience with Azure DevOps and CI-CD, with Terraform and Databricks Asset Bundles highly relevant.
- Domain experience in financial services or insurance data, including financial reconciliation, general ledger, or accounting data.
- Experience with AI-driven data quality, anomaly detection, and automated reconciliation.
- Knowledge relevant to knowledge graphs, ontologies, semantic layers, or enterprise Text-to-SQL solutions.
- Working knowledge of Azure security, data governance, PII protection, and fine-grained access controls.
- MLOps/LLMOps experience, including model evaluation and production AI monitoring.
- Ability to demonstrate recent production coding experience. This is a hands-on Lead Data Engineer role, not a purely managerial or coordination position.
- Willingness and ability to work onsite in Cary, NC from Day 1 on Tuesday–Thursday.
Technologies you may use
Python, PySpark, Scala, SQL; Azure Databricks, Delta Lake, Jobs/Workflows, Unity Catalog; Azure Data Factory (ADF), ADLS Gen2; lakehouse / medallion architecture; LangChain, LlamaIndex, LangGraph; Azure OpenAI, OpenAI, Databricks Model Serving; Azure DevOps, CI-CD, Terraform, Databricks Asset Bundles; Text-to-SQL; MLOps, LLMOps.
Role details
- Location: Cary, NC (hybrid)
- Onsite schedule: Tuesday–Thursday from Day 1
- Employment: Full-time
- Experience: 10–15 years (minimum listed: 12 years)
- Compensation: USD 145,000 - 160,000 per year