Senior Data Engineer

For over half a decade, Hudson Manpower has been a trusted partner in delivering specialized talent and technology solutions across IT, Energy, and Engineering industries worldwide. We work closely with startups, mid-sized firms, and Fortune 500 clients to support their digital transformation journeys. Our teams are empowered to bring fresh ideas, shape innovative solutions, and drive meaningful impact for our clients. If you're looking to grow in an environment where your expertise is valued and your voice matters, then Hudson Manpower is the place for you. Join us and collaborate with forward thinking professionals who are passionate about building the future of work.

Job Description

Must Have Skills: (this should be the summary – cut through the one-page description into the must-haves)

- 6- 9 years experience

- GCP

- Python

- SQL

- Spark

- Rally

- PySpark

- Hive

- Functional Testing

- Big Data

Key Responsibilities

- Develop and maintain robust data pipelines using Python, PySpark, and SQL.

- Design and optimize data workflows on Google Cloud Platform (GCP).

- Implement and manage data storage solutions using Hive and other big data technologies.

- Collaborate with cross-functional teams to understand data requirements and deliver solutions.

- Conduct functional testing to ensure data accuracy and reliability.

- Utilize Rally for agile project tracking and task management.

- Ensure data quality, integrity, and security across all systems.

Required Skills & Qualifications

- Proficiency in Python, SQL, and PySpark.

- Hands-on experience with Google Cloud Platform (GCP) services.

- Strong understanding of Hive and big data ecosystems.

- Experience with functional testing in data engineering environments.

- Familiarity with Rally or similar agile project management tools.

- Bachelor’s degree in Computer Science, Engineering, or related field.