Position Summary:
The Data Engineer will be responsible for building and maintaining robust data pipelines, integrating data from multiple sources, and supporting the overall data architecture. This role will also involve ensuring the integrity, consistency, and quality of data across systems, as well as supporting data operations related to mergers and acquisitions. You will collaborate with cross-functional teams to streamline data processes and enhance data-driven decision-making.
Responsibilities:
Data Integration and Automation
•Develop and maintain data pipelines for efficient data processing, including ETL/ELT processes from various sources such as APIs and databases.
•Implement and automate processes to ensure data consistency, coherence, and integrity across various systems.
•Utilize tools and techniques to maintain data consistency, such as data matching and change capture.
Database Administration and Support
•Perform routine database maintenance tasks, including testing backups, performance tuning, alerting, and security patching.
•Monitor database performance and troubleshoot issues to ensure optimal uptime and efficiency.
Internal Data Processes
•Collaborate with stakeholders to define and document internal data processes and procedures.
•Support the adoption of approved datasets across the organization, focusing on data access over pre-built reports.
•Provide ongoing support and training to users on data-related tools, systems, and processes.
•Continuously evaluate and improve data processes to enhance efficiency and effectiveness.
M&A Support
•Develop and implement processes for onboarding new data sources and applications, especially those related to mergers and acquisitions.
•Cleanse, transform, and prepare data for analysis and reporting, ensuring data quality and accuracy.
•Any and all duties as requested or required.
Skills and Competencies:
•Strong understanding of data management principles and best practices
•Proficiency in Microsoft SQL and PowerBI
•Experience writing and maintaining API-based ETL/ELTs (Python preferred over ETL tools)
•Familiarity with cloud platforms (e.g., Azure, Snowflake)
•Expertise in scripting languages (e.g., Python, PowerShell)
•Knowledge of Azure DevOps or other source control platforms
•Strong problem-solving and analytical abilities
•Excellent communication and collaboration skills, with the ability to work cross-functionally with technical and non-technical stakeholders
Qualifications:
•5+ years of experience in data operations, data engineering, or a related role
•Proficiency with data integration, pipeline development, and database management
•Experience with cloud-based data solutions and integration tools
•A strong understanding of database performance optimization, security, and backup processes
•Ability to support data-centric processes and manage multiple data initiatives simultaneously