Staff Software Engineer - Data Processing & Execution Platform

Dotmatics

Posted 2mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Define and drive system architecture for event-driven data processing services
Lead migration of key components to Node.js/TypeScript and Python
Contribute to and improve engineering standards, patterns, and best practices for distributed systems, observability, and reliability
Architect and implement asynchronous data processing pipelines for high-volume scientific data
Guarantee the scalability, maintainability, and security of software solutions
Take ownership of existing services and evolve them

12+ years experience in engineering
Degree in Computer Science, Software Engineering, or equivalent
Advanced working experience in Asynchronous processing
Strong proficiency in Node.js/TypeScript and Python for building production backend services
Proven experience designing and implementing distributed, event-driven systems
Experience implementing automated testing platforms, unit tests, and integration tests
Advanced working experience with large data processing platforms such as Spark, Databricks, or Snowflake
Experience managing state across multiple stores
Hands-on experience with AWS in production environments
Solid understanding of Kubernetes for orchestrating workloads
Proficiency with CI/CD tools such as GitHub Actions
Setting technical direction
Leading cross-team initiatives
Leveling up other engineers through mentoring and architectural guidance

Scala or other JVM languages
Message-based architectures using Kafka
Complex data pipelines, schema management, and incremental processing
AWS and/or GCP or designing systems portable across multiple cloud providers
Building scalable distributed systems using Kubernetes and other cloud-native technologies
Experience within Life Sciences or R&D data management

Skills