We’re committed to being the clean energy leader in Louisiana. By investing in renewables like solar and utilizing carbon capture and sequestration technology to make our air cleaner, we’re in this for the long haul, because our state and future generations depend on it. Come be a part of our journey at Cleco where we're Energizing Your Tomorrow.
The
Data Engineer IIis an experienced professional with knowledge of ETL processes, data architecture, and cloud platforms. Responsible for designing, implementing, and maintaining data pipelines into our data lakehouse. The incumbent contributes to building and developing the organization’s data infrastructure and supports the business to enable efficient data flow between applications to support analytics, business intelligence, and AI/ML use cases.
Key Responsibilities
- Build data pipelines from data sources to our azure databricks platform.
- Monitor pipeline performance and implement optimizations as needed
- Structure and optimize the datalake to optimize support of data reporting, business intelligence, and AI/ML development
- Create scripts that can be reused to preprocess data sets, perform analysis, etc.
- Research and implement cutting-edge techniques and tools to enable better data adoption across the business
- Assist in the creation of frameworks and processes to analyze unstructured information collected through social media platforms i.e., wikis, blogs, instant messaging, etc.
- Assist in the integration of current systems (e.g., SAP) and analytical techniques to enhance/streamline current operations and improve efficiency; assist with process automation by identifying areas to reduce routine manual tasks
- Champion a corporate culture that emphasizes transparency, integrity, safety, environmental responsibility, employee development, diversity and inclusion, customer service, and operational excellence
- Bachelor’s degree in computer science, software engineering, or related field. - 3-5+ years of related experience
- Experience with Azure Databricks, Azure Data Factory, or other Microsoft Cloud solutions are preferred
- Proficiency in developing ETL processes, and performing test and validation steps.
- Advanced Experience building ETL pipelines from various data sources. SAP, Oracle, and SQL Server are preferred.
- Experience with handling Realtime, Change Data Feed and Unstructured data is a plus.
- Proficiency in data manipulation(SQL, Python, R, Spark, etc.)
- Familiar in data visualization tools such as Tableau and PowerBI
- Strong communication (writing, speaking, storytelling), interpersonal, listening, and negotiation skills to communicate complex results to technical and non-technical audiences and influence with a consultative approach
- Strong customer focus and employee experience mindset
- Strong analytical, problem-solving, planning, and project management skills
- Willingness and ability to learn new technologies on the job
- Ability to exercise judgment with little direction/guidance but also knows when to escalate to the Manager of Data Science and Business Intelligence
- Proficient at functioning effectively within a team environment, present ideas and opinions in a respective and collegial manner
- Ability to interpret/write custom shell scripts. Python scripting is a plus.
- Experience with Azure platform and data bricks/similar platform
- Experience with Git / Azure DevOps
- Building Partnerships
- Leading Teams
- Business Acumen
- Communication
- Courage
- Building Self-Insight
- Driving for Results
- Energizing the Organization
- Driving Execution
- Building Trusting Relationships
- Driving Innovation
- Planning and Organizing
- Safety
- Establishing Strategic Direction
- Governance and Internal Control
- Financial Reporting and Data Analysis
- Industry and Business Knowledge
- Financial Systems
- Planning, Forecasting & Budgeting
- Business Partnering
- M&A Analysis
- Project and Change Management
May Perform Other Duties As Assigned.
Salary dependent on experience, skills, education, and training.