Sign in Start free trial

Senior Data Engineer

Invoca

Location: Greater Los Angeles Area · SF Bay Area · Denver Metro +5
Workplace: Remote
Employment: Full Time
Salary: USD 127,000–190,000/yr

Apply on the employer’s site

Posted 1mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Responsibilities

Design, build, and operate scalable batch and streaming data pipelines
Extend and evolve the architecture of the Databricks lakehouse
Build curated training and fine-tuning corpora and evaluation datasets
Champion pipeline testing, CI/CD, and data quality monitoring
Ensure responsible data handling, governance, and PII protection
Mentor others across data science, engineering, and architecture
Partner with technical leadership to prioritize data platform investments

Requirements

5+ years of professional experience in data engineering
Advanced proficiency in Python, PySpark, and modern data processing libraries
Advanced proficiency in SQL, performance tuning, and data modeling
Strong experience with Databricks platform or equivalent lakehouse stack
Strong experience with Apache Spark at scale
Experience with workflow orchestration tools like Airflow or Dagster
Experience with data quality, monitoring, and pipeline reliability practices
Experience with streaming data technologies like Kafka or Kinesis
Working knowledge of cloud infrastructure, preferably AWS
Familiarity with data needs of ML and AI systems
Bachelor's Degree or equivalent experience

Preferred

Experience handling sensitive data in HIPAA/PCI contexts

Skills

Python
PySpark
Pandas
Polars
PyArrow
SQL
MySQL
PostgreSQL
Databricks
Delta Lake
Unity Catalog
Workflows
Snowflake
BigQuery
Apache Spark
Airflow
Dagster
Kafka
Kinesis
Spark Structured Streaming
AWS
S3
IAM
FastAPI
SageMaker

Similar roles