Lead Specialist - Databricks Developer

Are you interested in joining our team? Chat with our digital assistant to learn more about our company and apply right from your mobile device!

Text ETP to 25000 to get started

or apply through this web posting if you prefer.

Energy Transfer , recognized by Forbes as one of America's best large employers , is dedicated to responsibly and safely delivering America’s energy . We are driven to inspire our employees to create superior value for our customers, our investors, a sustainable future and giving back to the community where w e have long-standing commitments to causes including MD Anderson Children’s Cancer Hospital, The Salvation Army, The American Red Cross, Ronald McDonald House and many more.

We value all of our employees who make our growth and success possible. We are proud to offer industry leading compensation, comprehensive benefits, 401(k) match with additional profit sharing, PTO and abundant career opportunities.

Come join our award winning 12,000 strong organization as we fuel the world and each other!

Summary

We are looking for a BI Developer with a passion for data and loves to stay on the edge of new techniques and technologies. The ideal candidate who has experience with the Microsoft Azure BI stack, as well as traditional BI experience will help our diverse team to modernize our BI landscape. This candidate will work to break down barriers and evangelize the latest tools and techniques in Business Intelligence to cultivate a data-driven culture throughout the company.

Cloud Functions Essential Duties & Responsibilities:

- Design and implement end-to-end data solutions using Microsoft Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), Azure Databricks, Power BI/Fabric.

- Develop, monitor, and maintain scalable data pipelines to support analytics and data science projects.

- Utilize Azure Databricks to perform complex data transformation, aggregation, and machine learning tasks.

- Assist with designing the architecture and workflow for an Enterprise Data Warehouse in Databricks that leverages a growing Citizen Development population who wish to build their own Data Marts

On-Prem Functions

- Maintain and enhance existing ETL Pipelines, Warehouses, and Reporting leveraging traditional MS SQL Stack

- Primarily SQL Server, SSIS, and SSRS.

- Assist with server and system administration of On-Prem BI infrastructure such as Power BI/Azure Gateway servers, Business Objects, Tableau, and SSRS.

General

- Collaborate with cross-functional teams to translate business needs into technical specifications and data models.

- Ensure data quality and integrity by implementing best practices and data governance standards

- Provide ongoing support and enhancements to existing data structures and reporting environments.

- Stay current with industry trends and advancements in BI and data analytics technologies.

- Lead prototype efforts in various BI tools for capability assessment and demonstrations.

- Leverage AI tools to assist with the creation, maintenance, and updating of comprehensive documentation for all data solutions and processes.

- Implement and manage source control practices using GIT within Azure DevOps to ensure code integrity and facilitate collaboration.

- Participate in the development and maintenance of CI/CD pipelines for automated testing and deployment of BI solutions.

- Provide general support to BI customers, addressing queries and issues in a timely and effective manner.

Requirements: Education and/or Experience, Knowledge, Skills & Abilities: To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements for this position are listed below

:

- Bachelor’s degree in Computer Science, Management Information Systems, or related field.

- Minimum 3 years of experience in Databricks and Azure stack.

- Proficient in Azure Data Factory, Azure Data Lake Storage, and Azure Databricks.

- Skilled in Python/Spark

- Understanding of cloud and distributed systems principles, including load balancing, networks, scaling etc.

- Minimum 3 years of experience in traditional SQL BI Stack

- Strong understanding of SQL, data warehousing concepts, and ETL processes.

- Experience with data modeling, data visualization, and reporting tools.

- Ability to write clean, well-documented, and efficient code.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills to work effectively in a team environment

- Must be able to work on multiple simultaneous tasks with limited supervision. Able to follow change management procedures and internal guidelines

- Strong time-management skills, initiative, commitment, and ability to work under pressure to meet tight deadlines while maintaining high quality standards and best practices.

Required Experience Is Commensurate With The Selected Job Level

- The Senior IT Specialist level requires a Bachelor's degree or equivalent experience and 5-8 years of relevant job related experience

- The Lead IT Specialist level requires a Bachelor's degree or equivalent experience and 8+ years of relevant job related experience - The Principal IT Specialist level requires a Bachelor's degree or equivalent experience and 10+ years of relevant job related experience.

Working Conditions:

The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job.

- Usually, normal office working conditions.

- Must be able to remain in a stationary position 50% of the time due to prolonged periods of sitting or standing.

- Occasional travel may be required.

Preferred Qualifications

- Experience in Oil & Gas industry, particularly Midstream.

- Experience warehousing or reporting against SAP/S4/HANA.

- Experience with consuming and developing REST API, JSON, XML, and/or JavaScript

- Confidence in several programming languages such as R, Python, Scala, or Java, with the ability to pick up new languages and technologies quickly.

- ITIL Certification or experience using Remedy application is a plus