Data Engineer Architect

Lead the architectural design and evolution of secure, scalable cloud data platforms supporting analytics, AI/ML, and business intelligence.

Responsibilities

• Design and develop enterprise-grade data platforms using Databricks, Delta Lake, and Azure Data Services
• Define and enforce technical standards, design principles, and best practices to improve consistency, reusability, scalability, and maintainability
• Architect and optimize data warehouse and lakehouse solutions, including Snowflake and star schemas, plus distributed data system patterns
• Lead integration of real-time and batch data pipelines for analytics, ML model training, and reporting use cases
• Design secure, compliant, high-performance data architectures aligned to data governance, privacy, and access-control standards
• Provide technical leadership for infrastructure as code, automated pipeline orchestration, and observability practices
• Evaluate emerging data technologies, cloud capabilities, and design patterns; recommend adoption when appropriate
• Mentor senior and mid-level data engineers; promote architectural rigor and continuous learning
• Collaborate with data scientists, BI developers, enterprise architects, and business stakeholders to deliver aligned, high-impact solutions
• Create and maintain architectural documentation, including design blueprints, system diagrams, and roadmaps
• Lead proof-of-concept work, technical deep dives, and architecture reviews to validate approaches and guide high-risk decisions
• Troubleshoot complex architectural and performance issues across the data ecosystem, focusing on resilience, cost efficiency, and system health
• Share knowledge through internal and external forums, technical presentations, and other engineering events
• Perform other duties as required

Requirements

• 8-12 years of progressive data engineering experience, including extensive leadership of large-scale, cloud-native data solution architecture and implementation
• Expert proficiency with Databricks, including Delta Live Tables, Unity Catalog, and Spark performance tuning
• Deep experience with Azure Data Services, including Azure Data Factory and Event Hubs
• Strong mastery of data modeling, warehousing, and big data processing (including dimensional modeling, streaming architectures, and data lakehouse patterns)
• Working knowledge of data governance, metadata management, security, and regulatory compliance in cloud environments
• Familiarity with orchestration, infrastructure as code (including Terraform and Azure Resource Manager), and monitoring frameworks
• Deep knowledge of Python, SQL, Spark, and distributed data systems
• Ability to architect systems for downstream AI/ML and business intelligence consumption layers
• Proven record of technical leadership on high-impact projects, including mentoring senior engineers and influencing enterprise data strategies
• Advanced architectural design capability across performance, scalability, resilience, security, and cost optimization
• Excellent written, verbal, and presentation skills for technical and non-technical stakeholders
• Strong analytical and problem-solving skills for complex cross-platform data challenges
• Highly organized with experience managing competing priorities across teams and initiatives
• Bachelor’s degree in computer science, data engineering, information systems, or related technical field (advanced degree preferred)
• Industry certifications highly desirable, such as Databricks Certified Data Engineer Professional, Microsoft Fabric Data Engineer Associate, or Azure Solutions Architect Expert

Technologies

• Databricks
• Delta Lake
• Azure Data Services
• Snowflake
• star schemas
• real-time and batch data pipelines
• Delta Live Tables
• Unity Catalog
• Spark performance tuning
• Azure Data Factory
• Event Hubs
• dimensional modeling
• streaming architectures
• data lakehouse patterns
• Python
• SQL
• Spark
• distributed data systems
• Terraform
• Azure Resource Manager
• infrastructure as code
• monitoring frameworks
• ML model training
• AI/ML
• business intelligence

Benefits

• Medical, dental, and vision insurance
• 401(k) with company match
• Associate discounts including furniture
• Company paid life and disability insurance
• Paid time off
• Employee Assistance Program
• Wellness Programs

Location & Experience

• Location: Brookhaven, GA (onsite)
• Minimum experience: 8 years