Senior Data Engineer
MatchDB Talent- Location
- Sydney
- Workplace
- Remote
- Employment
- Full Time
- Salary
- AUD 125,000–175,000/yr
Posted 8mo ago
Our client is looking for a Sr. Data Engineer who thrives on solving complex data challenges, designing robust architectures, and optimising big data pipelines. You’ll work with cutting-edge cloud and AI solutions, ensuring that data is accessible, scalable, and analytics-ready.
This role blends deep technical expertise, strategic problem-solving, and hands-on implementation. You’ll build and optimise ETL pipelines, data lakes, and data platforms while collaborating with cross-functional teams to drive AI-powered insights.
- Build scalable data architectures – Design and implement high-performance data pipelines and cloud-native solutions.
- Optimise big data processing – Develop efficient and cost-effective data solutions using Databricks, Apache Spark™, and Delta Lake.
- Ensure data quality and governance – Implement best practices for data validation, lineage, and security.
- Drive automation and efficiency – Use Python, Scala, or SQL to automate data workflows and streamline processes.
- Collaborate with cross-functional teams – Work with data scientists, analysts, and engineers to deliver data-driven solutions.
- Stay ahead of the curve – Continuously explore new data engineering trends, AI advancements, and cloud technologies.
Qualifications
- 3+ years of experience in data engineering, big data, or cloud data solutions.
- Proficiency in Python, Scala, or SQL for building scalable data pipelines.
- Experience with Databricks, Apache Spark™, and Delta Lake.
- Familiarity with cloud platforms (AWS, Azure) and modern data architectures.
- Understanding of ETL processes, data lakes, and warehouse solutions.
- Excellent problem-solving skills – Able to tackle complex data challenges with innovative solutions.
- A passion for automation, AI, and optimising data workflows.
Preferred Qualifications
- Databricks Certification (e.g., Databricks Certified Data Engineer or ML Associate).
- Experience with real-time streaming architectures (Kafka, Kinesis, or similar).
- Knowledge of AI/ML pipelines and MLOps best practices.
- Prior experience in a consulting or client-facing role.
Benefits
- Be part of an AI-native company – We live and breathe cutting-edge AI and data solutions.
- Work on high-impact projects – We partner with industry leaders to solve some of the toughest data challenges.
- Shape the future of data engineering – Be at the forefront of AI-driven transformation.
- Competitive compensation – We offer a generous salary and performance-based bonuses.
- Flexible work culture – Hybrid and remote work options to fit your lifestyle.
- Grow with us – Access top-tier learning resources, training, and leadership development programs.
Compensation
The base pay range for this role is A$125,000 – A$175,000 per year.
Skills
- ETL
- Databricks
- Spark
- Delta Lake
- Python
- Scala
- SQL
- AWS
- Azure
- Machine Learning
- Kafka
- AWS Kinesis
- MLOps
Similar roles
Senior Data Analyst
Westpac Group · Sydney, NSW, Australia · today
Senior Data Analyst
Go1 Australia · Australia · today
Data Architect
Pwc · Canberra · yesterday
Data Analyst
Bgis · Parramatta, New South Wales, Australia · yesterday
Staff Data Scientist, Office of the Founders
Linktree · Melbourne, VIC · Sydney, NSW · 2d ago
Senior Data Scientist (Marketing)
DoorDash ANZ · Sydney, NSW · Melbourne, VIC · 2d ago