Senior Spark Data Engineer

About the Company

This is an open position with FirstEnergy Service Co., a subsidiary of FirstEnergy Corp. As a Senior Spark Data Engineer at FirstEnergy you will work on an Agile team that is digitally enabling the company by building data pipelines that drive analytic solutions. These solutions will generate insights from the connected data, enabling the organization to advance the data-driven decision-making capabilities of the enterprise. This role requires deep understanding of data architecture, data engineering, data analysis, reporting, and a basic understanding of data science techniques and workflows. The ideal candidate is a skilled data and software engineer with experience creating data products supporting analytic solutions. Our digital projects benefit the community by aiding in providing safe, reliable electricity to everyone:

- Customer:

create analytics to improve customer satisfaction along the customer journey for a lifetime as they move-in to a residence, pay their bill and move to new residences.

- Transmission & Distribution:

develop algorithms to detect asset failures, reduce outages and provide reliable electricity to customers.

- Smart Meter:

provide customers with the electric usage they need to make smart decisions about their home as well as reduce threats and theft in the electric system.

About the Role

What you’ll do: Serve as the subject matter expert in technologies used for our data strategy in the cloud. Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Solve complex data problems to deliver insights that helps the organization's business to achieve their goals. Create data products for analytics and data scientist team members to improve their productivity. Advise, consult, mentor and coach other data and analytic professionals on data standards and practices. Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions. Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering to improve the organization's productivity as a team. Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.

Responsibilities

- Serve as the subject matter expert in technologies used for our data strategy in the cloud.

- Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals.

- Solve complex data problems to deliver insights that helps the organization's business to achieve their goals.

- Create data products for analytics and data scientist team members to improve their productivity.

- Advise, consult, mentor and coach other data and analytic professionals on data standards and practices.

- Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.

- Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering to improve the organization's productivity as a team.

- Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.

Qualifications

- Bachelor’s degree in a quantitative discipline such as Computer Science, MIS or related field with 10 years of related experience.

- Related Experience includes but is not limited to: Development and tuning on any RDBMS technology (Oracle, SQL Server, Teradata, SingleStore).

Required Skills

- Strong knowledge of using Spark for fast imagery and big data processing.

- Expert knowledge in managing and tuning of Data Lake and Lakehouse storage objects with accompanying data engineering pipelines.

- Expert knowledge in Python and SQL development and troubleshooting.

- Willingness to undertake assignments involving unfamiliar subjects and demonstrate aptitude to learn quickly.

- Excel at communicating complex ideas and concepts both verbally and through writing.

- Experience in Agile/Scrum development with DevOps methodologies geared toward rapid prototyping and piloting of cloud solutions.

- Prefer 8 or more years of knowledge and experience in development and tuning of ETL processes using any type of ETL tool or architecture.

- Experience in creating, analyzing and documenting ER and Dimensional models.

- Unix/Linux experience is preferred. Data Engineers maintain Unix files, commands, and scripts, which requires an understanding of Unix operating system concepts.

- Prefer 4 - 5 years of experience in using the Kimball methodology to design and develop Enterprise Data Warehouses and Data Marts.

- Prefer 3 or more years of experience with Spark in a Databricks environment.

- Prefer 3 or more years of experience with imagery (or other big data) processing and/or data preparation with Spark.

- Prefer 6 or more years of experience using Python (preferably in a Data Engineering or Data Science role).

- Understanding of data replication tools (such as: Informatica Data Replication or Oracle GoldenGate).

- Experience in designing and/or developing Analytics applications using tools such as Power BI, QlikView, SAS, RapidMiner or other comparable products.

- Willingness to travel throughout organization and service territory and work extended hours, as required.

Preferred Skills

- Experience in creating, analyzing and documenting ER and Dimensional models.

- Unix/Linux experience is preferred.

- Prefer 4 - 5 years of experience in using the Kimball methodology to design and develop Enterprise Data Warehouses and Data Marts.

- Prefer 3 or more years of experience with Spark in a Databricks environment.

- Prefer 3 or more years of experience with imagery (or other big data) processing and/or data preparation with Spark.

- Prefer 6 or more years of experience using Python (preferably in a Data Engineering or Data Science role).

Package

At FirstEnergy, employees are key to our success. We depend on their talents to meet the challenges of our changing business environment. We are committed to rewarding individual and team efforts through our total rewards philosophy which includes competitive pay plus incentive compensation, a company-sponsored pension plan, 401(k) savings plan with matching employer contribution, a choice of medical, prescription drug, dental, vision, and life insurance programs, as well as skills development training with tuition reimbursement. Please visit our website at www.firstenergycorp.com to learn more about all of our employee rewards programs.