JobHabor

Senior Databricks Engineer

FullStack

Location
USA
Workplace
Remote
Employment
Full Time
Salary
Apply on the employer’s site

Posted 2mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Responsibilities

  • Design and build production-grade data pipelines on Databricks
  • Implement multi-hop architectures
  • Build data services, APIs, or microservices for data consumption
  • Implement monitoring, observability, and error handling
  • Optimize data workloads for performance and cost efficiency
  • Debug and resolve issues in distributed systems
  • Create and maintain continuous integration and delivery of applications

Requirements

  • 5+ years of professional data engineering experience
  • Advanced English is required
  • Successful completion of a four-year college degree is required
  • Strong experience designing and building production-grade data pipelines on Databricks
  • Deep hands-on expertise with Apache Spark (Spark SQL and PySpark)
  • Advanced knowledge of Delta Lake, including ACID transactions and data versioning
  • Expert-level SQL and Python, with a focus on scalable data transformations
  • Proven experience implementing multi-hop architectures
  • Strong understanding of software engineering principles applied to data systems
  • Experience building data services, APIs, or microservices for data consumption
  • Demonstrated ability to implement monitoring, observability, and error handling
  • Experience optimizing data workloads for performance and cost efficiency
  • Familiarity with data quality frameworks and automated validation
  • Ability to debug and resolve issues in distributed systems
  • Experience working in regulated environments with strict security requirements
  • Ability to work through new and difficult issues and contribute to libraries as needed
  • Ability to create and maintain continuous integration and delivery of applications
  • Forensic attention to detail
  • A positive mindset and a can-do attitude
  • Experience working on Agile / Scrum teams
  • Meaningful experience working on large, complex systems
  • Ability to take extreme ownership over your work
  • Ability to identify with the goals of FullStack's clients, and dedicate yourself to delivering on the commitments you and your team make to them
  • Ability to consistently work 40 hours per week

Preferred

  • Experience working on Agile / Scrum teams

Skills

  • Databricks
  • Apache Spark
  • Spark SQL
  • PySpark
  • Delta Lake
  • SQL
  • Python
  • CI/CD

Similar roles