J
Data Engineer III - Python/PySpark/Databricks/AI
Job Description
Join an agile team supporting trusted data collection, storage, access, and analytics solutions with enterprise-authorized AI tools.
Responsibilities
- Support review of controls to help ensure sufficient protection of enterprise data
- Advise and implement custom configuration changes in one to two tools to deliver requested products for business or customer needs
- Update logical or physical data models as new use cases emerge
- Use SQL regularly, with an understanding of NoSQL databases and where they fit in the market
- Develop, test, and maintain critical data pipelines and architectures using SQL/NoSQL
- Apply enterprise-authorized AI capabilities to accelerate data pipeline and design analysis and documentation, including:
- Validate AI outputs
- Handle data according to sensitivity and security requirements
- Use reuse-first, AI-assisted practices to strengthen SDLC-quality routines for data pipelines, including:
- Test generation
- Control validation
- Maintaining traceability/auditability
- Alignment to resiliency and security expectations
Requirements
- 3+ years applied experience plus formal training or certification in data engineering concepts
- Experience across the data lifecycle
- Advanced SQL skills (including joins and aggregations)
- Working understanding of NoSQL databases
- Demonstrated experience using enterprise-authorized AI capabilities in data engineering workflows, with:
- Strong validation habits
- Awareness of data sensitivity
- Ability to review and validate AI-assisted outputs (examples include query suggestions, test ideas, or model change summaries) before use, escalating when uncertain and following data handling requirements
- Significant experience with statistical data analysis, including selecting appropriate tools and data patterns for analysis
- Experience customizing changes in a tool to generate a product
Technologies
- SQL
- NoSQL
- AI
- Python
- PySpark
- Databricks
Benefits
- Comprehensive health care coverage
- On-site health and wellness centers
- A retirement savings plan
- Backup childcare
- Tuition reimbursement
- Mental health support
- Financial coaching
Preferred Qualifications
- Exposure to cloud technologies
- Exposure to AI-driven development
Location: Atlanta, GA (onsite)
Experience: 3+ years