EngineerJobs.io
← Back to all jobs

Job Description

Design, govern, and scale enterprise Databricks Lakehouse platforms with NTT DATA’s Databricks Center of Excellence (CoE). This onsite role in Plano, TX focuses on hands-on platform engineering, delivering client-facing use cases, and enabling adoption of modern Databricks capabilities across regulated enterprise environments.

What you’ll work on

  • Design and deploy enterprise-scale Databricks Lakehouse platforms across AWS and Azure
  • Establish secure, governed environments using Unity Catalog, role-based access controls, and data lineage
  • Define platform standards, reusable patterns, and guardrails to support scalable adoption
  • Optimize performance, cost, and reliability for production workloads
  • Implement CI/CD, environment promotion, and DevOps automation for Databricks
  • Lead adoption of modern Databricks features including Unity Catalog, Dataflow / declarative pipelines, and Genie / AI-assisted development
  • Enable AI/BI dashboards, model serving, and advanced analytics use cases
  • Build and optimize batch and streaming pipelines using Apache Spark and Delta Lake
  • Develop data products and domain-oriented pipelines aligned to enterprise data strategies
  • Own end-to-end use case delivery from requirements to production deployment
  • Drive data quality, observability, and pipeline reliability
  • Act as a trusted advisor to client stakeholders across architecture, data, risk, and business teams
  • Lead workshops, solution design sessions, and platform adoption strategies
  • Support proposals, solutioning, and client innovations within regulated industries
  • Contribute to NTT DATA accelerators, frameworks, and reusable assets
  • Define best practices, reference architectures, and playbooks for enterprise Databricks adoption
  • Mentor junior engineers and support capability building across the CoE

What you bring

  • 12+ years of experience in data engineering, platform engineering, or data architecture
  • 5+ years hands-on Databricks experience in large enterprise environments
  • Deep expertise in Apache Spark (Scala/Python)
  • Deep expertise in Delta Lake and Lakehouse architectures
  • Deep expertise in Databricks workspace setup, cluster policies, and job orchestration
  • Strong experience with AWS, Azure, or GCP
  • Experience implementing data governance, security, and compliance controls
  • Proven ability to design and deliver scalable, production-grade data platforms
  • Client-facing communication and stakeholder skills

Tools you’ll use

  • Databricks, Unity Catalog, Dataflow, Genie
  • Apache Spark, Scala, Python, Delta Lake, Lakehouse
  • AWS, Azure, GCP
  • CI/CD, DevOps automation
  • Kafka, Structured Streaming
  • MLOps, Model Serving, AI/BI
  • AI-assisted development workflows, agent-based tooling

Location: Plano, TX (onsite). Additional locations listed: Minneapolis, MN | Chicago, IL | Atlanta, GA.

Experience level: 12+ years overall; 5+ years with Databricks (enterprise-scale).

Preferred qualifications

  • Experience in financial services or other regulated industries
  • Familiarity with data governance frameworks, regulatory reporting, and risk data environments
  • Databricks certifications (for example, Data Engineer, Solutions Architect)
  • Experience with Real-time streaming (Kafka, Structured Streaming)
  • Experience with MLOps / Model Serving
  • Experience with Data marketplace / data product architectures
  • Exposure to AI-assisted development workflows and agent-based tooling

Similar Jobs