Southern Company

Data Engineer

LocationAtlanta, GA
Job TypeFull-time

About This Job


Data Engineer


Work Location(s):


Atlanta, Georgia or Birmingham, Alabama


JOB SUMMARY

The Data Engineer role will be part of the Marketing Technology Solutions team within the Customer Technology Solutions Organization in Southern Company’s Technology Organization’s Electric Technology Solutions tower. Position responsibilities include Energy Information Exchange (EIX) data scheme versioning and management.

The Data Engineer will work with stakeholders – both business and Technology Organization to design and develop data-oriented solution architecture involving On-Prem and cloud (Microsoft Azure) technologies that align with and support the business and Technology Organization strategy and standards. This role will also work hands on to implement solutions. Additionally, this role will be responsible for management and alignment of solutions across all technology platforms working closely with developers & infrastructure teams to optimize application code, ensuring reusable services, optimizing performance & resource utilization, planning capacity, and ensuring application/data security.


JOB REQUIREMENTS


Education:

BS/BA required, preferably in Computer Science, Management Information Systems, Engineering or other technology related field.


Experience:

Experience with Databricks.
Experience with a major cloud platform, preferably Microsoft Azure and services including CosmosDB, Storage Application Services, Azure Data Factory.
Experience architecting data-oriented solutions utilizing Cloud (preferably Azure) data architecture platforms and patterns.
Experience optimizing cloud PaaS resources to adhere to best practices & reduce cost.
Experience with Agile as well as DevOps, CI/CD methodologies.
Experience developing complex logical and physical data models.
Experience implementing lakehouses with medallion architecture, including data engineering pipelines and data storage layers.
Experience with dynamic metadata driven frameworks and large-scale data ingestion patterns.
Familiarity with streaming datasets and Databricks delta live tables.
Experience with performance tuning techniques in a lakehouse environment, such as partitioning, aggregations, materialized views, etc.


Knowledge/Skills/Attributes:

Databricks Platform: Proficiency in Databricks is essential. Should be comfortable working with Databricks notebooks, clusters, and jobs.
Data Engineering Tools: Familiarity with tools like Apache Spark, Delta Lake, and MLflow is valuable. These technologies are at the core of Databricks’ offerings.
Cloud Platforms: Data Bricks Engineers at Southern Company work with the Azure.
Knowledge of cloud PaaS architecture & resources.
Knowledge of structured & unstructured data – databases, data warehouses, and data lakes.
Knowledge and understanding of software development technologies, methodology and associated tools.
Excellent root cause analysis & problem-solving skills
Strong technical writing skills preferred.


JOB RESPONSIBILITIES

Data Pipeline Development: Design and develop robust data pipelines to ingest, store, and process data from various sources. These pipelines ensure efficient data flow for analytics and reporting.
Data Modeling: Create and maintain data models that support data analysis and reporting. These models help organize and structure data for efficient querying and visualization.
ETL Processes: Build and maintain Extract, Transform, Load (ETL) processes. These processes move data between systems, ensuring data quality and consistency.
Data Lakes: Work on data lakes to optimize storage and retrieval for analytical purposes.
Architect, develop, implement, integrate, and/or support cloud technology solutions in a manner that meets or exceeds business partner expectations for quality, cost, and timeliness.
Quickly become the team’s SME (Subject Matter Expert) for data architecture & Databricks.
Communicate effectively and timely with customers, team members, and management.
Build effective relationships with peers, management, and business partners.
Ensure required documentation for projects is developed.
Adhere to Change Management policies and procedures.
Respond/Resolve quickly & effectively to all operational problems.
Be a student of the business, taking care to understand the challenges & goals of our company.
Exhibit Our Values.

Southern Company (NYSE: SO) is a leading energy provider serving 9 million residential and commercial customers across the Southeast and beyond through its family of companies. Providing clean, safe, reliable and affordable energy with excellent service is our mission. The company has electric operating companies in three states, natural gas distribution companies in four states, a competitive generation company, a leading distributed energy infrastructure company with national capabilities, a fiber optics network, and telecommunications services. Through an industry-leading commitment to innovation, resilience, and sustainability, we are taking action to meet our customers’ and communities’ needs while advancing our commitment to net zero emissions by 2050. Our uncompromising values ensure we put the needs of those we serve at the center of everything we do and are the key to our sustained success. We are transforming energy into economic, environmental and social progress for tomorrow. Our corporate culture and hiring practices have earned the company national awards and recognition from numerous organizations, including Forbes, Military Times, DiversityInc, Black Enterprise, J.D. Power, Fortune, Human Rights Campaign and more. To learn more, visit www.southerncompany.com .

Southern Company invests in the well-being of its employees and their families through a comprehensive total rewards strategy that includes competitive base salary, annual incentive awards for eligible employees and health, welfare and retirement benefits designed to support physical, financial, and emotional/social well-being. This position may also be eligible for additional compensation, such as an incentive program, with the amount of any bonus/awards subject to the terms and conditions of the applicable incentive plan(s). A summary of the benefits offered for this position can be found here https://seo.nlx.org/southernco/pdf/SOCO-Benefits.pdf . Additional and specific details about total compensation and benefits will also be provided during the hiring process.

Southern Company is an equal opportunity employer where an applicant's qualifications are considered without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity or expression, or any other basis prohibited by law.


Job Identification: 11612


Job Category: Information Technology


Job Schedule: Full time


Company: Southern Company Services


Similar Jobs

Trending Jobs

company-logo

Nuclear Technical Intern - Mid Atlantic

Constellation
Job TypeInternship
 
Lusby, MD
24 days ago
company-logo

Apprentice Lineman

Brink Constructors, Inc.
Job TypeFull-time
 
Rapid City, SD
23 days ago
company-logo

Deckhand (Houston)

John W. Stone Oil Distributor, LLC
 
Houston, TX
24 days ago
company-logo

Electrical Engineer

Dudley Staffing
Job TypeFull-time
Salary
$55 - $75
Canonsburg, Pennsylvania
3 months ago
company-logo

Director, Financial Planning & Analysis - Energy (Enterprise)

Pilot Thomas Logistics
Job TypeFull-time
 
Grapevine, TX
24 days ago
company-logo

Solar Electrician

MN8 Energy
Job TypeFull-time
 
California, United States
22 days ago
company-logo

Quality Engineer

Jedco Inc.
Job TypeFull-time
 
Grand Rapids, MI
18 days ago
company-logo

Gas Foreman

Peak Utility Services Group
Job TypeFull-time
 
Lawton, OK
23 days ago
company-logo

Sr. Polymer Scientist

ExxonMobil
Job TypeFull-time
 
Baytown, TX
22 days ago
company-logo

Apprentice Lineman I

San Patricio Electric Cooperative, Inc.
Job TypeFull-time
 
Sinton, TX
8 days ago
company-logo

Finishing Helper Entry Level- Dayshift

Bonnell Aluminum
Salary
$41600 - $41600
Carthage, TN
18 days ago
company-logo

contract landman

HPS Oil & Gas Properties
Job TypeFull-time
 
Lafayette, Louisiana
about 2 months ago
SD

Service Manager

Supertech Diesel Truck Specialists
Job TypeFull-time
 
Langley, BC
21 days ago
company-logo

Apprentice Line Worker I

Tampa Electric
Job TypeFull-time
 
Ruskin, FL
about 1 month ago
company-logo

Meter Technician

ONEOK
Job TypeFull-time
 
Odessa, TX
24 days ago
SD

Service Manager

Supertech Diesel Truck Specialists
Job TypeFull-time
 
Nanaimo, BC
21 days ago
company-logo

Apprentice Power Lineman

Proline Power Corp.
Job TypeFull-time, Apprenticeship
 
Red Deer, AB
28 days ago
company-logo

Senior Landman

Greenlake Energy
Job TypeFull-time
 
Austin, Texas
15 days ago
company-logo

Assembler/Production

Uptalent
Job TypeContract
Salary
$37440 - $49920
Oklahoma City, OK
17 days ago
company-logo

Senior Investigator

Dominion Energy
Job TypeFull-time
 
Norfolk, VA
24 days ago