JobHabor

Data Engineer III

Location
United States
Workplace
Remote
Employment
Full Time
Salary
USD 115,000–130,000/yr
Apply on the employer’s site

Posted 27d ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Responsibilities

  • Maintain existing data engineering solutions and improve them
  • Determine business requirements and create solutions with data integrity
  • Collaborate to consolidate the data landscape and increase consistency
  • Lead and design complex projects delivering business value
  • Train and coach junior engineers in data engineering best practices

Requirements

  • 6+ years of experience working within data systems
  • 4+ years troubleshooting stored procedures and T-SQL code
  • 4+ years of experience with Airflow
  • 4+ years of Python coding using Pandas, Numpy, and other libraries
  • Experience with Microsoft SQL Server 2019 or later
  • Experience with AWS data engineering: S3, Lambda, boto3, SQS/SNS
  • Experience with in-memory databases such as Redis and Elasticache
  • Knowledge of file formats: JSON, CSV, Parquet, fixed-width
  • Comfortable with source control (Bitbucket, git, GitHub)
  • Bachelor's/Master's degree in Engineering, Computer Science or equivalent

Preferred

  • Experience working with C# or other statically typed languages
  • Experience working with external REST APIs

Skills

  • T-SQL
  • Airflow
  • Python
  • Pandas
  • Numpy
  • Microsoft SQL Server
  • AWS
  • S3
  • Lambda
  • boto3
  • SQS
  • SNS
  • Redis
  • Elasticache
  • JSON
  • CSV
  • Parquet
  • Bitbucket
  • git
  • GitHub
  • C#
  • REST APIs

Similar roles