Sr. AI & Data Engineer

Accenture is hiring a Sr. AI & Data Engineer for a hybrid role based in Irving, TX. In this position, you will work hands-on across Azure data services and Azure Databricks to architect and optimize scalable pipelines and agent-driven data experiences.

This role involves designing governed data platforms, enabling advanced analytics and AI use cases, and maintaining reliable pipeline performance. The hybrid schedule requires three days per week in the office within the specified hiring locations.

What You’ll Do

• Architect, develop, and maintain scalable, low-latency data pipelines to ingest and transform diverse datasets using Azure Databricks workflows and Spark technologies.
• Design and optimize Lakehouse architecture with Delta Lake tables following Bronze, Silver, and Gold layers for efficient, reliable, governed storage.
• Collaborate with data scientists and business analysts to deliver clean, validated, and well-modeled datasets for advanced analytics and AI initiatives.
• Design and implement autonomous agents using the Databricks Mosaic AI Agent Framework, including frameworks such as LangChain or AutoGen.
• Build and optimize vector search indexes with Databricks Vector Search to support accurate context retrieval.
• Process large-scale distributed datasets on the Databricks Intelligence Platform using Apache Spark.
• Design and implement data models aligned to business requirements and improving overall data usability.
• Continuously evaluate and improve data architecture processes to enhance efficiency and effectiveness.
• Develop AI agents with retrieval, orchestration, tool invocation, evaluation harnesses, and lifecycle observability.
• Monitor pipeline health and performance, and implement automated alerting and observability frameworks to enable faster troubleshooting and proactive optimization.

Minimum Qualifications

• 3+ years of professional experience as a Data & AI Engineer or in a related role.
• 3+ years of experience with Microsoft Azure cloud data services.
• 2+ years of experience with Databricks including PySpark, SQL, Delta Lake, and workflows.
• Bachelor’s degree or equivalent (minimum 12 years work experience). If an Associate Degree is held, minimum 6 years work experience is required.

Technologies

• Databricks, Azure data services, Azure Databricks, Spark, Apache Spark
• Databricks Mosaic AI Agent Framework, LangChain, AutoGen
• Delta Lake, Bronze, Silver, Gold layers (Lakehouse Medallion Architecture)
• Databricks Vector Search
• Databricks Intelligence Platform
• PySpark, SQL
• Git-based version control, CI/CD pipelines, Azure DevOps, GitHub Actions
• Auto Loader
• MLOps / LLMOps, Genie product family
• Databricks Certified Data Engineer Professional (2025)
• Microsoft Certified: Azure Data Engineer Associate

Benefits

• Medical, dental, vision, life, and long-term disability coverage
• 401(k) plan
• Bonus opportunities
• Paid holidays
• Paid time off

Preferred

• Advanced Python (PySpark) and SQL for data transformation and pipeline development.
• Experience with Azure Databricks including Spark, Delta Lake, Auto Loader, and Lakehouse Medallion Architecture (Bronze, Silver, Gold).
• Experience with Git-based version control and CI/CD pipelines using Azure DevOps or GitHub Actions.
• Experience in agent development using Mosaic AI Agent Framework.
• Strong problem-solving and performance optimization skills.
• Experience in MLOps / LLMOps including CI/CD for ML and LLM lifecycle.
• Experience with Genie product family.
• Databricks Certified Data Engineer Professional (2025).
• Microsoft Certified: Azure Data Engineer Associate.

Compensation: USD 59,100 - 205,800 per year.