JobHabor

Senior Data Engineer

CareScout

Location
Connecticut · Delaware · Florida +20
Workplace
Remote
Employment
Full Time
Salary
USD 114,900–227,000/yr
Apply on the employer’s site

Posted 4mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Responsibilities

  • Design, build, and maintain scalable ETL/ELT pipelines using Spark, Python, SQL, and Databricks
  • Implement reliable ingestion frameworks for batch and streaming data sources
  • Ensure pipelines meet SLAs, data quality standards, and production-grade reliability
  • Develop robust data models across raw, curated, and semantic layers using Delta Lake
  • Create dimensional models, star schemas, and domain-layer datasets for analytics and ML
  • Implement data validation, anomaly detection, SLAs, and documentation across pipelines
  • Build automated tests, monitoring, and alerting for freshness, completeness, and accuracy

Requirements

  • 7+ years of experience in data engineering or related roles
  • Strong expertise with Python, SQL, Spark, and distributed data processing
  • Hands-on experience with Databricks, Delta Lake, and Lakehouse architectures
  • Deep understanding of ETL/ELT design, data modeling, and data quality practices
  • Experience building scalable, production-grade data pipelines
  • Experience collaborating with analytics, ML, and product teams
  • Strong communication skills with the ability to clarify data requirements and explain technical decisions

Skills

  • Spark
  • Python
  • SQL
  • Databricks
  • Delta Lake
  • Unity Catalog

Similar roles