Data Engineer

Summary Of Purpose:

The data engineer I is responsible for designing, building, and maintaining a company's data infrastructure, including databases and data pipelines, to ensure accurate and timely data access for analysis by collecting, processing, and transforming raw data into usable formats for other stakeholders within an organization; requiring strong programming skills in languages like Python and SQL, expertise in data modeling, and knowledge of cloud computing platforms to manage real time data effectively

Responsibilities will include hands-on implementation and development of ETL, API, streaming, and other integration tools running on-prem or cloud. The services built by the data engineer I will enable web applications, mobile applications and integration with 3rd party systems. This role will also design how features should be implemented and help determine the best architecture to use in each situation.

Essential Functions

- Designs, implements, and optimizes data pipelines to ingest, process, and transform large volumes of structured and unstructured data from various sources

- Develops robust Extract, Transform, Load (ETL) processes to integrate data from diverse sources into the data ecosystem

- Creates data models to structure and organize data within databases and data warehouses, ensuring efficient data access and analysis

- Implements data quality checks and monitoring mechanisms to identify and address data inconsistencies

- Works closely with internal IT stakeholders and business users to understand data requirements and deliver actionable insights

- Performs other duties as assigned

Knowledge, Skills, And Abilities

- Demonstrates strong knowledge of relevant specialty area, leading important initiatives, offering guidance to team members, and promoting innovation and strategic improvements within the organization

- Advanced ability to communicate complex information in a clear and understandable manner to stakeholders

- Ability to lead diverse teams to achieve common goals, while mentoring team members

- Demonstrates advanced planning, organizational, and time management skills, leading multiple projects, guiding team members, and driving strategic initiatives to achieve organizational goals

- Strong ability to conduct research, gather information, and stay current with industry trends and best practices to influence change within relevant specialty area

- Advanced ability to analyze data, trends, and complex problems to problem solve within relevant specialty area

- Exemplifies a strong ability to seek out and learn from feedback, coaching, and new experiences. Proactively adapts to new challenges and leverages learnings to drive innovation and mentor others

- Demonstrated ability to facilitate collaboration across various departments to harness collective creativity and drive innovative solutions. Utilize strong communication skills to effectively convey ideas and lead discussions. Demonstrated impact in cross-functional projects, ensuring alignment and synergy among diverse teams

- Ability to work and maintain confidentiality of highly sensitive/private information

- Understanding of data governance best practices to ensure data quality and compliance

- Proficiency in programming languages such as Python, SQL, and potentially other languages like .Net, C#, etc.

- Experience with data warehouse solutions like Azure Synapse and others

- Understanding of data modeling concepts such as dimensional modeling or star schema

- Proficiency with data integration tools to combine data from disparate sources

- Prior experience with cloud services such as Azure

Education, Licenses, and Certifications

Required

- High School Diploma or GED

Preferred

- Bachelor’s degree with major coursework in computer science, information systems, or a closely related field or commensurate studies and experience

Experience Required

- Four or more years of professional work experience, including work in T-SQL and Database modelling

- Two or more years of experience in dimensional modelling

- Two or more years Agile/Scrum experience

- Two or more years of experience working on data warehousing technologies

- Two or more years of experience in programming languages such as Python, .NET C#, etc

Preferred

- Experience with cloud data platforms such as Azure Synapse etc.

- Proficiency in SQL Server Analytics systems.

- Familiarity with Denodo and Elastic Search

Additional Requirements

Work Context

- Must be able to work prolonged periods of sitting at a desk and working on a computer

- Must be able to work under minimal supervision

- Must be able to sit, stand, walk, stoop, kneel, crouch, climb, and crawl

- Must be able to lift 25 pounds

- Must have a US state or territory issued Real ID compliant driver’s license or identification card

Behaviors and Assessments

- All INPO employees are expected to abide by behavioral expectations as outlined in INPO’s Core Values, Team Effectiveness Attributes, and Leadership Effectiveness Attributes

- Employment is dependent upon successfully completing a pre-employment background check and drug and alcohol test

- This position may require obtaining unescorted access status

- This position requires direct or indirect access to certain export-controlled technology, for which INPO may be required to obtain an export license in accordance with applicable U.S. export control laws and regulations. If an export license is required, any offer of employment at INPO for this position is contingent upon receipt of the export license or authorization