Overview:
We are seeking a skilled Senior Data Engineer to support the implementation of a modern cloud-based ERP system. This role will be critical in designing and developing data integration pipelines across cloud platforms, with a focus on enabling seamless data flow between finance, operations, and HR systems. The ideal candidate will bring strong experience in cloud data engineering, ETL processes, API development, and data governance.
Key Responsibilities:
Cloud Data Engineering & Integration:
•Design and implement scalable data pipelines across AWS, Azure, and Google Cloud.
•Integrate SAP BTP with cloud and on-premise systems for smooth data exchange.
ETL & Data Pipeline Development:
•Build and optimize ETL workflows using Pentaho, Microsoft ADF, or equivalent tools.
•Ensure reliable data ingestion and transformation processes with high performance.
API Development & Integration:
•Create and integrate RESTful APIs for real-time and batch data transfer.
•Utilize OAuth, JWT, and other secure authentication methods.
Data Analysis & SQL Development:
•Write efficient SQL queries and stored procedures for data reporting and validation.
•Conduct data profiling and reconciliation to support data accuracy.
Data Governance & Quality:
•Work with tools such as Ataccama and Collibra to implement data quality standards.
•Maintain data lineage, metadata management, and compliance documentation.
Cloud & DevOps:
•Use Azure DevOps and GitHub for CI/CD, version control, and pipeline deployment.
•Automate workflows using serverless technologies (e.g., AWS Lambda, Azure Functions).
Collaboration & Documentation:
•Collaborate with cross-functional teams including analysts, architects, and SAP teams.
•Create and maintain documentation for workflows, data models, and integrations.
Required Skills & Experience:
•7+ years of experience in data engineering, ETL development, and SQL.
•Strong hands-on experience with SAP BTP Integration Suite.
•Proficiency in Pentaho (PDI), Microsoft ADF, and REST API development.
•Solid understanding of cloud platforms: AWS, Azure, GCP.
•Experience with data governance tools like Ataccama and Collibra.
•Familiar with CI/CD processes and DevOps tools (Azure DevOps, GitHub).
Preferred Qualifications:
•Experience in SAP S/4HANA and ERP cloud implementations.
•Knowledge of Python, PySpark, or similar data processing languages.
•Understanding of event-driven architectures and serverless data workflows.
Education & Certifications:
•Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
•Preferred Certifications:
•Microsoft Azure Data Engineer Associate
•SAP Certified Associate – Integration Developer
Job Type: Contract
Pay: $70.00 - $80.00 per hour
Expected hours: 37.50 per week
Schedule:
Work Location: Hybrid remote in White Plains, NY 10601