Cloud Data and Solution Engineer

Overview JOB DESCRIPTION

Experience in building and managing scalable data and AI solutions with Microsoft Platform such as Azure Synapse, MS Fabric, and Lake type storage. Skilled in developing and managing machine learning models and handling various data science tasks. Knowledgeable about analytical platform, security, data governance, AI/ML operations and DevOps.

Responsibilities Essential Duties (Approximate % of Time Spent) List Duties And Group Similar Items

- Work as an Azure cloud data and solution engineer, an individual contributor, and a team player.

- Analyze, design, and determine coding, programming, and integration activities required based on specific objectives.

- Manage data pipeline job failures.

- Optimization of existing ML jobs for better performance.

- Develop processes, techniques, and tools to analyze and monitor platform performance.

- Strong working knowledge of MS Analytics Platforms such as MS Fabric, Synapse, and Data Lakes.

- Experience in developing and managing AI/ML Models.

- Experience with Gen AI Models.

- Experience in AI and ML Ops.

- Experience in the Azure cloud ecosystem.

- Experience in managing databases and objects.

- Experience Azure Data Lake Storage with Azure Synapse.

- Knowledgeable in programming languages such as SQL, Python, and Pyspark.

- Identify, troubleshoot, and resolve issues related to data and AI jobs.

- Support ingestion pipelines from a data engineering standpoint.

- Participation in the design of data models for reports.

- Experience with Azure Functions and API integration.

Non-Essential Duties: Performs other duties as assigned.

- Negotiate and influence changes outside of the team that continuously shape and improve the Data strategy.

- Participate or run critical engagements, consistently delivering quality services. Drive high-quality work products within expected timeframes and on budget.

- Collaborate with advance analytics team.

All employees shall be in compliance with the Archrock Health Safety and Environmental Policy and local, statutory and/or regulatory requirements at all times.

Qualifications

Skills and Abilities:

Ability To

- Build and manage Data Pipelines

- Build and manage data models

- Build and manage AI Models

- Manage and build reports in MS Fabric

- Manage Azure Data Lake Storage

- Use TSQL (Queries, Functions, Stored Procedures)

- Code using Python and Pyspark

Knowledge

- MS Fabric, Power BI

- Python, Pyspark and TSql

- Azure DevOps

- AI and Machine Learning

- Data engineering in Azure

Minimum Education And Certification

- Bachelor's degree and preferred master’s degree

Minimum Experience

- Preferred 3+ years of AI/ML/Data science and Data Lake experience

Leadership

- Customer-focused professional who is motivated to drive the creation of great data engineering platforms.

- Contribute to the continued evolution of Corporate Analytics Platform

- Responsible for managing a growing cloud-based data ecosystem.

Problem Solving And Innovation

- Ability to define and create complex to simple models to build insights, predictions, and innovations from data.

- Expected to identify opportunities and to provide ideas, methods and innovations to enhance teamwork, efficiency and quality.