The Electric Operations Technology Solutions (EOTS) team at Southern Company is seeking a Data Engineer to build, operationalize, and maintain data pipelines that enable data, analytics, and AI use cases across hybrid and multi-cloud environments. This role helps turn source data into consumable formats while supporting scalable, reliable integration for multiple business areas using Databricks and Azure.
Based in the Birmingham area with a hybrid schedule, the position also focuses on standardizing data curation and taxonomy and delivering solutions across the EOTS organization, with participation on the EOTS Leadership Team for strategic business solution delivery.
Responsibilities
- Design and develop methods to process structured, semi-structured, and unstructured data using both batch and real-time techniques
- Develop release pipelines to automate build, version control, and deployment tasks
- Build and maintain reusable templates, code libraries, and semantic models
- Establish gatekeeping and guard rail processes for promoting data into production
- Collaborate with cross-functional teams across data, business, and technical stakeholders
- Promote data reusability and modular data product delivery
- Define and enforce data quality and data integrity controls
- Provide technical guidance to less experienced data engineers
- Optimize performance using parallel processing and minimal data movement
- Stay current with data technologies and share insights across the organization
- Standardize, design, and develop Databricks applications, data integrations, and automated business processes
- Integrate data from multiple systems, databases, APIs, and business applications
- Provide technical guidance, knowledge sharing, and support for business users and fellow data engineers
Requirements
- Bachelor’s degree in Computer Science, Engineering, Machine Learning, or related field
- Experience with batch and real-time data processing frameworks
- Experience with big data technologies (e.g., Hadoop, HIVE, Spark)
- Experience with AI/ML solutions in Python
- 4+ years with on-prem tools (e.g., MSBI, Informatica, Oracle Golden Gate, SQL Server)
- 2+ years with Microsoft Azure tools (e.g., Data Lake, Data Factory, Databricks, Synapse, Power BI)
- Experience with containerization (e.g., Docker, OpenShift)
- Proficiency in data modeling, access, storage, and quality tools
- Familiarity with Agile, DevOps, and CI/CD methodologies
- Strong communication and collaboration skills
- Ability to lead and mentor others
- Familiarity with performance optimization and data governance
- Proactive in sharing knowledge and best practices
- Hands-on expertise with Databricks, SQL, Python, and Apache Spark
- Proficiency in data modeling for analytics and machine learning
Key Technologies
- Databricks
- Azure
- Python
- Apache Spark
- SQL
- Hadoop
- HIVE
- MSBI
- Informatica
- Oracle Golden Gate
- SQL Server
- Microsoft Azure Data Lake
- Data Factory
- Synapse
- Power BI
- Docker
- OpenShift
Location and Work Model
- Hybrid location in Birmingham, AL (The Energy Center) or Atlanta, GA (30 Ivan Allen)
- Onsite schedule: 4 days per week onsite / 1 day per week remote
Compensation and Benefits
- Competitive base salary
- Annual incentive awards for eligible employees
- Health, welfare and retirement benefits designed to support physical, financial, and emotional/social well-being
- Additional compensation, such as an incentive program (subject to the terms and conditions of the applicable incentive plan(s))
- Benefits summary: https://seo.nlx.org/southernco/pdf/SOCO-Benefits.pdf
Southern Company is an equal opportunity employer where an applicant’s qualifications are considered without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity or expression, or any other basis prohibited by law.
