Senior AWS Data Engineer

Senior AWS Data Engineer
Notice info
LocationGreater Chicago Area
Job Typefull time
On-site
Oil and Gas

About This Job

LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial markets, we enable businesses and economies around the world to fund innovation, manage risk and create jobs. It’s how we’ve contributed to supporting the financial stability and growth of communities and economies globally for more than 300 years.

FTSE Russell, part of the London Stock Exchange Group, is an essential index partner for a changing world, providing category-defining indices across asset classes and investment objectives to create new possibilities for the global investment community. FTSE Russell’s expertise and products are used extensively by institutional and retail investors globally.

Job Summary:

Contribute to building brand new data platforms in AWS, using Python and Spark. Be part of a dynamic team, building data solutions in a supportive and hybrid work environment. This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with innovative technologies. You will design, implement, and optimize ETL workflows using Python and Spark, contributing to our robust data Lakehouse architecture on AWS. Success in this role requires technical expertise, strong problem-solving skills, and the ability to collaborate effectively within an agile team.

Must Have Tech Skills:

Demonstrable experience as a senior data engineer.
Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.
Experience of implementing data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena
Experience with data services in a Lakehouse architecture.


Nice To Have Tech Skills:

Experience in solution architecture and technical design, allowing for the creation of scalable, reliable data architectures that meet both technical and business requirements
A master’s degree or equivalent experience or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous


Key Accountabilities:

Provides guidance on standard methodologies in design, development, and implementation, ensuring solutions meet business requirements and technical standards.
Works closely with architects, Product Owners, and Dev team members to decompose solutions into Epics, leading design and planning of these components.
Drive the migration of existing data processing workflows to the Lakehouse architecture, using Iceberg capabilities.
Communicates complex technical information clearly, tailoring messages to the appropriate audience to ensure alignment.

Key Skills:

Deep technical knowledge of data engineering solutions and practices. Implementation of data pipelines using AWS data services and Lakehouse capabilities.

Highly proficient in Python, Spark and familiar with a variety of development technologies. This knowledge enables the Senior Data Engineer to adapt solutions to project-specific needs.

Skilled in decomposing solutions into components (Epics, stories) to streamline development.

Proficient in creating clear, comprehensive documentation. Ensures that documentation supports technical teams' knowledge and compliance, making it accessible and valuable for future reference

Proficient in quality assurance practices, including code reviews, automated testing, and standard methodologies for data validation.

Experience in using automation tools and Continuous Integration/Continuous Deployment (CI/CD) pipelines to streamline development, testing, and deployment.

Educational Background:

Bachelor’s degree or equivalent experience in computer science, Software Engineering, or related field essential.

Preferred Skills:

Financial Services expertise preferred, working with Equity and Fixed Income asset classes and a working knowledge of Indices.

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.

Our purpose is the foundation on which our culture is built. Our values of

Integrity, Partnership

,

Excellence

and

Change

underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.

Working with us means that you will be part of a dynamic organisation of 25,000 people across 65 countries. However, we will value your individuality and enable you to bring your true self to work so you can help enrich our diverse workforce. You will be part of a collaborative and creative culture where we encourage new ideas and are committed to sustainability across our global business. You will experience the critical role we have in helping to re-engineer the financial ecosystem to support and drive sustainable economic growth. Together, we are aiming to achieve this growth by accelerating the just transition to net zero, enabling growth of the green economy and creating inclusive economic opportunity.

LSEG offers a range of tailored benefits and support, including healthcare, retirement planning, paid volunteering days and wellbeing initiatives.

We are proud to be an equal opportunities employer. This means that we do not discriminate on the basis of anyone’s race, religion, colour, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law. Conforming with applicable law, we can reasonably accommodate applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.

Please take a moment to read this privacy notice carefully, as it describes what personal information London Stock Exchange Group (LSEG) (we) may hold about you, what it’s used for, and how it’s obtained, your rights and how to contact us as a data subject.

If you are submitting as a Recruitment Agency Partner, it is essential and your responsibility to ensure that candidates applying to LSEG are aware of this privacy notice.

Trending Jobs

company-logo

Electrical Engineer

Dudley Staffing
Job TypeFull time
Salary
$55 - $75
Canonsburg, PA
5 months ago
company-logo

Division Order Analyst

Coronado Resources
Job TypeFull time
 
Dallas, TX
2 months ago
company-logo

Professional Landman

Penterra Services, LLC
Job TypeContract
 
Lovington, NM
about 1 month ago
company-logo

Accounts Payable Clerk

LPR Energy
Job TypeFull time
Salary
$65000 - $65000
Dallas, TX
3 months ago
company-logo

Division Order Landman

R. Lacy Services, Ltd.
Job TypeFull time
 
Longview, TX
about 2 months ago
company-logo

Business Analyst – Accounting

Permian Resources
Job TypeFull time
Salary
$110000 - $150000
The Woodlands, Texas
13 days ago
company-logo

contract landman

HPS Oil & Gas Properties
Job TypeFull time
 
Lafayette, LA
5 months ago
company-logo

Oil and Gas Land and Title Analyst - SAM Associate II

Bank of America
Job TypeFull time
 
Dallas, TX
3 months ago
company-logo

Attorney

Toeppich & Associates
Job TypeFull time
 
Houston, TX
over 1 year ago
company-logo

Landman

Stockyards Energy Land Services
Job TypeContract
 
Akiachak, TX
7 months ago
company-logo

Title Landman

Sustain Land Services
Job TypeFull time
 
Norman, OK
4 months ago
company-logo

Senior Landman

Greenlake Energy
Job TypeFull time
 
Austin, TX
3 months ago
company-logo

Title Reviewer

Innovation Land Services
Job TypeFull time
 
Pittsburgh, PA
5 months ago
company-logo

contract Landman

HPS Oil & Gas Properties
Job TypeFull time
 
Midland, TX
5 months ago
company-logo

Oil and Gas Title Attorney

Oliva Gibbs PLLC
Job TypeFull time
 
Houston, TX
3 months ago
company-logo

Electrical Designer

Dudley Staffing
Job TypeFull time
Salary
$45 - $60
Canonsburg, PA
5 months ago
company-logo

Civil/Structural Designer

Dudley Staffing
Job TypeFull time
Salary
$30 - $60
Canonsburg, PA
5 months ago
company-logo

Data Analyst

River City Science Academy
Job TypeFull time
Salary
$20 - $45
Jacksonville, FL
4 months ago
company-logo

Software Integrations Developer

Permian Resources
Job TypeFull time
Salary
$160000 - $210000
The Woodlands, Texas
13 days ago
company-logo

Senior Division Order Analyst

Formentera
Job TypeFull time
Salary
$110000 - $130000
Austin, TX
about 1 year ago