Job Title: Databricks Data Engineer
Location: Fort Collins, CO (In office 3 days/week)
Duration: 6 months contract (with possibility of extension)
Role Description: We are seeking an experienced Databricks Data Engineer with strong expertise in developing data engineering pipelines utilizing Python notebooks (PySpark) and Spark SQL. The candidate must possess substantial hands-on experience with Databricks pipeline orchestration, Unity Catalog implementation, and automated testing frameworks within Databricks. Additionally, the candidate will contribute significantly to maintaining high data quality standards and provide mentorship to junior developers.
Key Responsibilities:
•Develop, implement, and optimize Databricks data pipelines using Python notebooks (PySpark) and Spark SQL.
•Orchestrate robust data engineering workflows in Databricks, managing pipeline dependencies, scheduling, and performance tuning.
•Implement and manage Unity Catalog for data governance, access control, and metadata management.
•Create and maintain automated testing frameworks to validate data integrity, transformation accuracy, and pipeline reliability.
•Proactively ensure data quality through comprehensive Python-based data quality checks and monitoring.
•Provide training and mentorship to team members, enhancing their capabilities in Databricks data engineering practices.
•Collaborate closely with cross-functional teams including Data Analysts, Data Scientists, and business stakeholders to ensure alignment and successful project outcomes.
Required Qualifications:
•5+ years specifically utilizing Databricks.
•Proficient in Python (PySpark) and SQL (Spark SQL).
•Demonstrated expertise in Databricks pipeline orchestration.
•Strong knowledge and experience with Unity Catalog.
•Proven skills in automated testing methodologies specific to Databricks environments.
•Hands-on experience integrating Git for version control and collaborative development workflows.
•Experience implementing robust data quality solutions using Python.
•Excellent communication skills and a proven ability to train and mentor junior team members.
Preferred Experience:
•Familiarity with Fivetran integrations.
•Experience working within a medallion data architecture (Bronze, Silver, Gold).
We invite passionate and detail-oriented professionals to apply, contributing to a transformative data project that significantly enhances our business intelligence and analytics capabilities.
Note: that this position requires being in the office 3 days per week. Please do not apply if you are not in the Fort Collins Area, or willing to relocate.
Job Types: Full-time, Contract
Pay: $70.00 - $100.00 per hour
Benefits:
Compensation Package:
Schedule:
Ability to Commute:
•Fort Collins, CO 80525 (Required)
Ability to Relocate:
•Fort Collins, CO 80525: Relocate before starting work (Required)
Work Location: In person