Data Engineer

Kentro

Posted 1mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Develop, maintain, and optimize Databricks notebooks, workflows, and ETL/ELT pipelines
Build and maintain data ingestion pipelines using PySpark, SQL, and Delta Lake
Support Medallion Architecture and Lakehouse implementations
Assist with performance tuning, cluster optimization, and operational support
Support Unity Catalog, data governance, and security best practices
Support enterprise Master Data Management initiatives
Assist with data quality, matching, standardization, and data stewardship activities
Work with enterprise data governance teams to improve metadata, lineage, and business glossary
Ensure consistency and integrity of enterprise data across multiple systems
Partner with business users to understand reporting requirements
Support MI/BI reporting initiatives
Develop datasets supporting dashboards and analytics
Troubleshoot data quality and reporting issues
Participate in Agile ceremonies
Work with cross-functional technical teams
Document technical solutions and data flows
Participate in code reviews and knowledge sharing

Bachelor's degree in Computer Science, Information Systems, Data Engineering, or related field
Minimum of 5 years of experience designing, developing, and supporting enterprise data solutions using Databricks
Minimum of 5 years of experience with SQL and Python/PySpark
Experience developing ETL/ELT pipelines
Experience working with Delta Lake and Lakehouse architecture
Experience working within AWS cloud environments
Experience supporting enterprise data governance and data quality initiatives
Experience working in Agile development environments
Must possess an active Databricks certification
US Citizen

Experience with AWS services (S3, IAM, Lambda, Glue, EMR, Redshift, Athena, CloudFormation, CloudWatch)
Experience with Apache Spark
Experience with Unity Catalog
Experience with Master Data Management (MDM)
Experience with Informatica MDM, Reltio, or Profisee
Experience with Snowflake
Experience with Data Governance, Data Catalog, Metadata Management, or Data Lineage
Experience with Power BI or Tableau
Experience with Jira
Federal consulting experience
Experience supporting Public Trust programs

Skills