JobHabor

Senior Data Engineer

The Hanover

Location
Worcester, MA, USA
Workplace
Hybrid
Employment
Full Time
Salary
USD 100,000–125,000/yr
Apply on the employer’s site

Posted 3mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Responsibilities

  • Complete data integration, data warehouse design, and build scalable ETL pipelines
  • Display data engineering best practices for data storage, integration, transformation, and access within cloud and on-premises platforms
  • Ensure data security and compliance within industry standards
  • Develop and maintain documentation for data integration and ETL solutions
  • Build solutions within Azure Data Services
  • Create solutions using pySpark/SparkSQL, and Delta Tables
  • Create documentation for data processes
  • Collaborate with data scientists, analysts, and stakeholders
  • Coach, mentor, and serve as technical guidance for junior team members
  • Work within agile development methodologies and use DevOps best practices

Requirements

  • Bachelor’s degree or higher in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent
  • 5 plus years professional experience in data engineering, data architecture, and/or data integration
  • Advanced proficiency in SQL and Python
  • Experience working with Azure, AWS, GCP, or other cloud
  • Strong problem-solving, communication, and collaboration skills
  • Critical thinking and attention to detail
  • Must be eligible to work in the United States without requiring sponsorship now or in the future

Preferred

  • Microsoft DP-203 or DP-700 certification
  • Experience in optimizing data pipelines for scale, performance, reliability, and cost efficiency
  • PowerBI experience
  • Azure DevOps experience
  • Azure Synapse Analytics and/or Microsoft Fabric experience
  • Masters in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent
  • Actuarial or pricing experience within insurance industry

Skills

  • SQL
  • Python
  • Azure
  • AWS
  • GCP
  • pySpark
  • SparkSQL
  • Delta Tables
  • Azure Data Services
  • Azure Synapse Analytics
  • Azure SQL Database
  • Azure Data Lake Storage
  • APIs
  • File
  • SFTP/FTPS
  • Streaming Data
  • DB Connectors
  • SOAP
  • REST
  • Microsoft Fabric
  • PowerBI
  • Azure DevOps

Similar roles