TrekSoftware

Sr. Data Engineer, Databricks

LocationFort Collins, CO
Job TypeFull-time, Contract
Salary$145,600-$208,000

About This Job


Job Title: Databricks Data Engineer

Location: Fort Collins, CO (In office 3 days/week)

Duration: 6 months contract (with possibility of extension)

Role Description: We are seeking an experienced Databricks Data Engineer with strong expertise in developing data engineering pipelines utilizing Python notebooks (PySpark) and Spark SQL. The candidate must possess substantial hands-on experience with Databricks pipeline orchestration, Unity Catalog implementation, and automated testing frameworks within Databricks. Additionally, the candidate will contribute significantly to maintaining high data quality standards and provide mentorship to junior developers.


Key Responsibilities:

Develop, implement, and optimize Databricks data pipelines using Python notebooks (PySpark) and Spark SQL.
Orchestrate robust data engineering workflows in Databricks, managing pipeline dependencies, scheduling, and performance tuning.
Implement and manage Unity Catalog for data governance, access control, and metadata management.
Create and maintain automated testing frameworks to validate data integrity, transformation accuracy, and pipeline reliability.
Proactively ensure data quality through comprehensive Python-based data quality checks and monitoring.
Provide training and mentorship to team members, enhancing their capabilities in Databricks data engineering practices.
Collaborate closely with cross-functional teams including Data Analysts, Data Scientists, and business stakeholders to ensure alignment and successful project outcomes.


Required Qualifications:

5+ years specifically utilizing Databricks.
Proficient in Python (PySpark) and SQL (Spark SQL).
Demonstrated expertise in Databricks pipeline orchestration.
Strong knowledge and experience with Unity Catalog.
Proven skills in automated testing methodologies specific to Databricks environments.
Hands-on experience integrating Git for version control and collaborative development workflows.
Experience implementing robust data quality solutions using Python.
Excellent communication skills and a proven ability to train and mentor junior team members.


Preferred Experience:

Familiarity with Fivetran integrations.
Experience working within a medallion data architecture (Bronze, Silver, Gold).

We invite passionate and detail-oriented professionals to apply, contributing to a transformative data project that significantly enhances our business intelligence and analytics capabilities.

Note: that this position requires being in the office 3 days per week. Please do not apply if you are not in the Fort Collins Area, or willing to relocate.


Job Types: Full-time, Contract


Pay: $70.00 - $100.00 per hour


Benefits:


Paid time off


Compensation Package:

1099 contract
Hourly pay


Schedule:

8 hour shift
Monday to Friday


Ability to Commute:

Fort Collins, CO 80525 (Required)


Ability to Relocate:

Fort Collins, CO 80525: Relocate before starting work (Required)


Work Location: In person

Similar Jobs

Trending Jobs

company-logo

Assistant General Manager, Navy Yard Electric Utility

Job TypeFull-time
Salary
$108000 - $108000
Philadelphia, Pennsylvania
about 1 month ago
company-logo

Electrical Engineer

Dudley Staffing
Job TypeFull-time
Salary
$55 - $75
Canonsburg, Pennsylvania
4 months ago
company-logo

Division Order Analyst

Job TypeFull-time
 
Dallas, Texas
23 days ago
company-logo

Accounts Payable Clerk

Job TypeFull-time
Salary
$65000 - $65000
Dallas, Texas
about 1 month ago
company-logo

contract landman

HPS Oil & Gas Properties
Job TypeFull-time
 
Lafayette, Louisiana
3 months ago
company-logo

Oil and Gas Land and Title Analyst - SAM Associate II

Bank of America
Job TypeFull-time
 
Dallas, Texas
about 2 months ago
company-logo

Attorney

Toeppich & Associates
Job TypeFull-time
 
Houston, Texas
about 1 year ago
company-logo

Senior Landman

Greenlake Energy
Job TypeFull-time
 
Austin, Texas
about 2 months ago
company-logo

Contracts Administrator

Third Coast
Job TypeFull-time
Salary
$70000 - $85000
Houston, Texas
about 1 month ago
company-logo

Foundry Professionals

Penticton Foundry
Job TypeFull-time
 
British Columbia, Canada
25 days ago
company-logo

Electrical Designer

Dudley Staffing
Job TypeFull-time
Salary
$45 - $60
Canonsburg, Pennsylvania
4 months ago
company-logo

Title Landman

Sustain Land Services
Job TypeFull-time
 
Norman, Oklahoma
2 months ago
company-logo

Deckhand

Ballard Marine Construction
Job TypeFull-time
 
Bradenton, FL
27 days ago
company-logo

Landman

Stockyards Energy Land Services
Job TypeContract
 
Akiachak, Texas
5 months ago
company-logo

Apprentice Lineman

N Line Electric
Job TypeFull-time
Salary
$68640 - $106080
Longmont, CO
20 days ago
company-logo

HSE Operations Manager

ProPetro Services, Inc
Job Typefull_time
 
Midland, TX
9 days ago
company-logo

Mechanical/Piping Engineer

Dudley Staffing
Job TypeFull-time
Salary
$55 - $75
Canonsburg, Pennsylvania
4 months ago
company-logo

Apprentice Qualified Lineman (Local 125) - Various Locations - #113398

PacifiCorp
Job TypeFull-time
 
Truth Or Consequences, NM
29 days ago
company-logo

Lineman, Apprentice

Imperial Irrigation District
Job TypeFull-time
Salary
$82706 - $95679
Imperial, CA
26 days ago
company-logo

Lease Records Administrator

WEM Operating
Job TypeFull-time
 
Provo, Utah
about 2 months ago