Primary Purpose
JOB DESCRIPTION
The Tallgrass Energy Partners IT group is seeking an IT Business Intelligence Engineer (Data Engineer). We are seeking a highly skilled and experienced Senior Data Lakehouse Engineer with a strong background in the Microsoft stack, project planning, and expertise in data management. With over 4 years of hands-on experience, you will manage our lakehouse infrastructure's design, implementation, and optimization. Your focus on the Microsoft ecosystem with proficiency in Azure machine learning technologies, and familiarity with Oracle Analytics and Snowflake will be crucial in shaping our data landscape.
Responsibilities
Essential duties and responsibilities:
•Contribute to the design and architecture of a scalable data lakehouse, emphasizing the Microsoft stack.
•Collaborate with cross-functional teams to understand data requirements and design a scalable and efficient data lakehouse architecture.
•Infrastructure Implementation:
•Integrate with cloud-based storage solutions (Azure Data Lake Storage) to ensure seamless scalability and durability.
•Data Ingestion and Processing:
•Develop and optimize data pipelines for efficient ingestion of diverse data sources into the data lakehouse.
•Implement data processing frameworks to transform and cleanse data for downstream analytics and reporting.
•Establish and maintain robust metadata management practices to track lineage, quality, and data governance within the lakehouse using Microsoft Purview.
•Implement and manage metadata catalogs to enhance data discoverability and usability.
•Security and Compliance:
•Implement and enforce security measures to protect sensitive data within the lakehouse.
•Ensure compliance with data governance policies and industry regulations.
•Performance Optimization:
•Continuously monitor and optimize the performance of the data lakehouse, addressing bottlenecks and improving efficiency.
•Collaboration and Documentation:
•Collaborate with analysts and other stakeholders to understand their data needs and provide solutions.
•Create comprehensive documentation for data lakehouse architecture, processes, and best practices.
•Troubleshooting and Support:
•Provide support for data-related issues, troubleshoot problems, and implement solutions to ensure data integrity and availability.
•After hours support is an additional responsibility shared with others in the group.
•Working with users and software vendors to address issues and application upgrade activities.
•Mentor junior team members in developing soft and/or hard skills.
•Oversee installation of hardware and software.
•Deal with a wide variety of people with tact, courtesy, and professionalism.
•Speak clearly, both in person and by telephone, using a high level of verbal skills and listen carefully.
•Maintain a regular, dependable attendance and a consistently high level of performance.
•Will work non-traditional hours as needed.
•Maintain a high regard for personal safety, for the safety of company assets and employees, and the general public.
•Other daily, weekly, monthly, or special project duties as identified and defined.
•Other duties as assigned.
Qualifications
Minimum requirements:
Education
•Bachelor's or master's degree from an accredited institution in Computer Science, Management, Information Systems, Business Management, or a related discipline.
•A minimum of five (5) years of direct work experience in IT or a related discipline may be considered as a substitute for a degree.
Experience/Specific Knowledge
•Minimum of four (4) years overall IT experience.
•Minimum of four (4) years of recent experience focusing on data engineering, big data, data management, and project planning.
•Proven experience in data engineering and designing data Lakehouse architectures.
•Hands-on experience with data Lakehouse technologies and cloud-based storage solutions.
•Strong understanding of data governance, security, and compliance.
•Experience with Power BI
•Experience in the full product development life cycle.
•Established SQL skills in MS SQL and/or Oracle databases.
•Experience with Power BI to develop and maintain reports.
•Experience in effectively communicating business and technical issues to both technical and non-technical audiences.
•Experience in working on multiple assignments during the same time frame, juggling tasks based on relative priorities with supervision commensurate with grade level.
•Advanced proficiency level in MS Office applications that may include Excel, Word, Access, PowerPoint, and Outlook.
Certifications, Licenses & Registrations
•MS Azure and/or Fabric certifications are a plus.
•Must possess and maintain a valid driver’s license and a driving record satisfactory to the company and its insurers (for travel).
Competencies, Skills & Abilities
•Analytical thinker. Able to utilize functional understanding of the various components of systems in conjunction with technical knowledge to identify effective and efficient problem resolutions.
•Excellent organizational, time management, and communication skills; must communicate effectively with all levels of company personnel.
•Ability to work well both individually with minimal supervision and in a team environment where knowledge sharing is highly regarded and expected.
•Must be customer service oriented.
•Excellent problem-solving skills and the ability to work in a dynamic, collaborative environment.
•Ability to multitask effectively and meet deadlines.
•Good interpersonal skills with demonstrated ability to communicate systems requirements verbally and in writing.
•Must be able to perform all essential and marginal functions of the job.
•Must be able to work with a team, take direction from management, adhere to required work schedules, focus attention on details, and follow work rules.
•Ability to successfully perform multiple tasks with strict deadlines.
•Ability to organize and prioritize daily work.
Physical Demands
All the physical requirements listed below may be necessary for an employee to perform the essential functions of this job successfully. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
•Sitting; standing; walking or moving throughout the facility; driving; talking; seeing (specific vision abilities required by this job include close vision, distance vision, color vision, peripheral vision, depth perception and ability to adjust focus); hearing; feeling; bending or stooping; squatting or crouching; reaching; kneeling; pushing; pulling; lifting up to 25 lbs.
•Minimal safety hazards; general office working conditions.
•Must be able to sit for prolonged periods of time.
•The employee is regularly required to use hands to type, touch, handle, or feel. The employee is required to talk and hear. The employee is frequently required to stand and reach with hands and arms. The employee is occasionally required to walk and climb or balance. The employee must regularly lift and /or move up to 10 pounds and occasionally lift and/or move up to 25 pounds.
Working Conditions
•Required to carry a cell phone and be available to respond during working and non-working hours.
•The successful candidate will be required to clear a drug screen and a complete background check, including a credit report for certain positions, after an offer has been extended and prior to being employed.
Supervisory Responsibility
Preferred Education, Experience, Certifications, Competencies, Skills, & Abilities
Above the minimum requirements; not required but advantageous in this position:
•MBA or MIS highly preferred.
•Microsoft Azure and/or Fabric certifications are a plus.
•Familiarity with modern DevOps practices and tools is a plus.
Compensation
•The salary range for this role is $115,000 - $141,000/yr.
About Us
Tallgrass was named one of the 2023 Top Workplaces USA and highlighted in Colorado's Top Workplaces for the past seven consecutive years. Tallgrass is a leading energy infrastructure company focused on safely, reliably, and sustainably delivering the energy and services that power our nation and enable our quality of life.
At Tallgrass, we value our teams and strive to create an environment where employees feel respected, and their contributions are valued. We aim to support employees' physical, mental, and financial well-being through a comprehensive Total Rewards Program.
•Industry competitive pay
•Health insurance package options that include Flexible Spending & Health Savings Accounts
•401(k) with up to a 6% match that vests immediately plus an employer discretionary contribution of up to 4%
•Wellness Programs and Mental Health Resources
•Employer-paid life insurance, short-term disability, and long-term disability coverage
•Critical Illness & Accident Insurance
•Vacation, sick days, paid caregiver leave, volunteer and bereavement paid time off
•Identity theft protection
•Annual discretionary bonus
•Generous Tuition Reimbursement Program
•Company-paid holidays and floating holidays
•Company vehicle (if applicable)
•Employee discounts; vehicles, tires, cellular plans, and more
•Networking and employee engagement events
•Personal development to grow your career with us based on your strengths and interests
Application Deadline:
Recruiting timelines vary by position; however, all Tallgrass positions accept applications for at least five business days from the posting date. This position is open and still accepting applications.
Compensation
: Compensation ranges are provided in good faith based on what we anticipate when researching wages for this position at the state and national levels. We may ultimately pay more or less than the posted range. This salary range may also be modified in the future.
Notice to External Search Firms
: Tallgrass does not accept unsolicited resumes from search firms or employment agencies. Unsolicited referrals and resumes are considered Tallgrass property; therefore, Tallgrass will not pay a fee for any placement resulting from the receipt of an unsolicited referral. Approved vendors may be invited to refer talent for specific positions at Tallgrass's request only. A fully executed agreement with Tallgrass must be in place and current in these cases.
EEO Statement:
Tallgrass complies with all Equal Employment Opportunity (EEO) affirmative action laws and regulations. Tallgrass does not discriminate on the basis of age, race, religion, color, sex, national origin, marital status, genetic information, sexual orientation, gender Identity and expression, disability, veteran status, pregnancy status, or other status protected by law.