Data Engineer

Introduction:

At PipeCom, we are committed to seamlessly integrating SCADA and industrial automation solutions that connect control centers to field operations, ensuring safe, reliable, and efficient asset management. Our vision is to be the premier provider of turn-key automation and integration services, recognized for innovation, reliability, and setting the industry standard. We empower the upstream and midstream industries by combining cutting-edge technology with expert talent to drive success.

We are currently seeking an experienced Python Developer

to join the Big Data and Advanced Analytics department. The ideal candidate will have a strong background in object-oriented programming, data modeling, and designing robust data layers using ORMs and Pydantic. You will work closely with business domain experts to create and maintain an Enterprise Data Lakehouse that supports analytic use cases for midstream oil and gas operations, engineering, and measurement teams.

Responsibilities include:

- Design software modules that encapsulate data access and business logic, adhering to OOP best practices

- Build and maintain data models and schemas using SQLAlchemy ORM and Pydantic

- Develop reliable data pipelines to integrate disparate data sources

- Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives

The successful candidate will meet the following qualifications:

- 5+ years of experience as a Python developer, with a focus on OOP and data layer development - 3+ years of experience designing and maintaining data pipeline architectures

- Experience with widely used Python libraries for data processing and testing, including Pandas, Numpy, Pyarrow, Pytest, and Boto3

- Excellent communication skills with experience presenting complex concepts to technical and non-technical stakeholders

Experience in software development practices such as Design Principles and Patterns, Testing, Refactoring, CI/CD, and version control

Must Haves:

- 5+ years of professional software development experience with Python, with a strong emphasis on object-oriented design and best practices

- Experience designing and implementing data models and data access layers

- Experience with Pydantic for data validation and serialization

- Experience working with S3 object storage

Nice to Haves:

- Hands-on experience with SQLAlchemy ORM and Pydantic

- Experience with data pipeline orchestration and ETL framework

- Familiarity with cloud data platforms and distributed data processing

- Experience with front-end development

- Developed and maintained APIs using FastAPI and/or GraphQL