Senior Data Engineer

Atlassian

Posted 24d ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Own data problems end to end, delivering scalable, high quality, and well governed data assets that support analytics, experimentation, and strategic decision making
Design, build, and maintain robust end to end data pipelines and ELT workflows
Architect and implement data models and schemas for analytics, reporting and product use cases
Implement and enforce data quality, governance and logging standards by defining metrics, instrumentation, validation rules and anomaly detection
Collaborate cross functionally with product, engineering, analytics and data science teams to define measurement strategies and enable product analytics and experimentation
Design data models for efficient storage and retrieval
Improve data quality and reliability through internal tools/frameworks to detect data quality issues

Master's degree or foreign equivalent in Computer Science, Computer Engineering, Data Science, Statistics, IT, Electronic Engineering or related field, plus 3 years of related work experience (or Bachelor's degree plus 5 years of post-baccalaureate progressive experience)
3 years of experience with data modelling, data warehousing and analytical data design concepts
3 years of experience building data pipelines and micro services
3 years of experience using Spark or Airflow to process high-volume batch and streaming data
3 years of experience with cloud based data engineering, including AWS services such as S3, EMR, Kinesis, RDS or SQS
3 years of experience modeling across distributed and cloud based platforms such as Spark, Flink, Hive, Kafka, Airflow or AWS data services (Redshift/Athena/EMR)
3 years of experience programming in Python and Java
3 years of experience writing SQL in data structuring and data storage practices
3 years of experience applying modern software engineering practices such as Agile development, test driven development, or CI/CD to build production-grade data solutions

Skills