Work Schedule: Monday – Friday, 8 a.m.–5 p.m.
POSITION SUMMARY: As a Data Engineer at Beusa, you will own the performance, reliability, and cost-efficiency of our Databricks environment. You’ll design and optimize Delta tables, pipelines, and SQL Warehouse workloads so teams get fast, trustworthy data at the lowest reasonable cost. You will collaborate with cross-functional teams to translate requirements into high‑performing, production‑grade datasets and dashboards with clear SLAs.
ESSENTIAL FUNCTIONS: (The following duties and responsibilities are all essential job functions, as defined by the ADA, except for those that begin with the word "may.")
- Build and operate Lakehouse pipelines on Databricks (Bronze/Silver/Gold) using Delta Lake, Delta Live Tables (DLT), and/or Jobs.
- Own ingestion patterns (Autoloader, CDC, streaming) optimization
- Own data modeling, quality checks, and performance optimization.
- Own performance optimization – profile and tune Spark/SQL workloads: partitioning, clustering, constraints, liquid clustering (if applicable), manage table health.
- Engineer Delta tables for speed and cost: partitioning, Z-Ordering or clustering, constraints, file sizing; manage table health with Auto Optimize, OPTIMIZE, and VACUUM.
- Implement incremental processing patterns (MERGE with Change Data Feed, APPLY CHANGES INTO) with idempotency and exactly-once delivery.
- Partner with data consumers to deliver reliable, well-documented datasets with clear SLAs.
- Design, build, and implement interactive dashboards and reports using Power BI and other visualization tools.
- Collaborate with business units (Operations, Field Engineers, Assets) to gather requirements and translate them into technical solutions.
- Develop and maintain data models, ensuring data quality and integrity.
- Integrate data from multiple sources, including real-time field equipment and sensors.
- Continuously evaluate and adopt new data management and analytics technologies.
- Educate and support stakeholders on data tools and best practices.
- Advocate for Beusa’s digital transformation and data-driven decision-making.
- Engage with technology vendors and partners as needed.
- Occasional travel to meet with stakeholders.
- Perform other related duties as assigned to assist with successful operations and business continuity.
- Successfully passes background check, pre-employment drug screening, and any pre-employment aptitude and/or competency assessment(s).
- Valid U.S. driver’s license and ability to pass a background check.
- Daily in-person, predictable attendance.
- Bachelor’s degree in MIS, Computer Science, Engineering, IT, or related field.
- 3–5+ years of experience in a data-focused role (Business Intelligence, Data Analysis, Data Management, etc.).- Experience with Databricks Data Engineering, including Delta Live Tables (DLT).
- Strong PySpark/SparkSQL experience.
- Advanced SQL skills and experience with relational databases (Microsoft SQL Server preferred).
- Familiarity with Databricks Medallion architecture.
- Proficiency in Power BI (preferred), Tableau, Spotfire, or Sigma.
- Experience with dashboard creation and data visualization best practices.
- Ability to manage multiple projects and adapt to changing priorities.
- Strong analytical, problem-solving, and communication skills.
- Knowledge of data cleansing and preparation for analytics.
- Ability to explain complex technical concepts to non-technical users.
- Experience working in cross-functional teams.
The physical demands and work environment described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Frequently required to walk, sit, climb, bend, reach, and squat/kneel. The Data Engineer works primarily indoors and will be sitting for prolonged periods at a desk and working on a computer. Must be able to access and navigate each department at the organization’s facilities. The Data Engineer may be required to lift heavy objects; therefore, the Data Engineer must be able to lift 25lbs.
Work hours may include early morning, late afternoon/evening hours, and weekends in combination, depending on job demands.
The Company is committed to the cause of equal employment opportunity for all employees and applicants, thus abiding by all applicable state and federal laws. Our practices regarding employment, job promotion, compensation, training, and termination do not discriminate on the basis of race, color, religious creed, age, sex, national origin, veteran's status, disability, pregnancy, genetic information, or any other legally protected status. It is expected that all employees, both management and staff, will fully support these nondiscriminatory policies.
The company has reviewed this job description to ensure essential functions and duties have been included. It is not intended to be an exhaustive list of all functions, responsibilities, skills, and abilities.