Staff Software Engineer - Distributed Data Systems

Staff Software Engineer - Distributed Data Systems

Location: Location not stated
Workplace: —
Employment: Full Time
Salary: USD 182,400–247,000/yr

Apply on the employer’s site

Posted 1mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Responsibilities

Build next generation distributed data storage and processing systems
Develop Apache Spark as the open source standard for big data
Provide reliable high performance services for cloud storage backends
Build Delta Lake storage management system with ACID transactions and time travel
Develop Delta Pipelines to orchestrate tens of thousands of data pipelines
Build next generation query optimizer and execution engine

Requirements

BS or higher in Computer Science or related field
8+ years of production experience in Java, Scala, or C++
Strong foundation in algorithms and data structures
Experience with distributed systems, databases, and big data systems (Apache Spark, Hadoop)

Skills

Java
Scala
C++
Apache Spark
Hadoop
AWS S3
Azure Blob Store
Delta Lake
SQL