JobHabor

Data Engineer

Elder Research

Location
USA-Remote
Workplace
Remote
Employment
Full Time
Salary
Apply on the employer’s site

Posted 2mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Responsibilities

  • Design, build, and maintain scalable ETL pipelines
  • Implement standard processes for data quality, lineage, reliability, and performance
  • Ingest and transform data from diverse sources
  • Load, manage, and optimize data within Databricks Unity Catalog and SQL Server managed instances
  • Collaborate with cross-functional teams

Requirements

  • At least three (3) years of professional experience in data engineering or a related field
  • Strong SQL skills
  • Strong Python skills
  • Experience with data ingestion from flat files, JSON, XML, Excel, APIs, and graph databases
  • Hands-on experience loading, managing, and optimizing data within Databricks Unity Catalog
  • Hands-on experience loading, managing, and optimizing data within SQL Server managed instances
  • Proficient with streaming/batch ingestion frameworks
  • Proficient with modern Lakehouse architecture
  • Familiarity with data governance, data quality, and data management practices

Preferred

  • Experience supporting a fraud detection, anomaly detection, or financial oversight analytics environment

Skills

  • SQL
  • Python
  • JSON
  • XML
  • Databricks Unity Catalog
  • SQL Server
  • APIs

Similar roles