Senior Data Engineer (m/f/d)

About the tech stack

Azure Fabric, Azure Databricks, PySpark, Apache Spark, Python, SQL, Azure Data Platform, DBT, Snowflake, Docker, Kubernetes.

About your tasks

• Design and build scalable data pipelines that power high-impact data products across multiple business domains.
• Drive cloud data migration initiatives, helping modernize existing platforms and supporting the transition to Azure-based solutions.
• Transform and optimize large-scale datasets to enable reliable reporting, analytics, and business decision-making across the organization.
• Collaborate closely with Data Analysts, ML Engineers, DevOps Engineers, Backend Developers, Product Managers, and business stakeholders to deliver robust end-to-end data solutions.
• Contribute to engineering best practices by promoting clean, maintainable code, automation, and continuous improvements across the data platform.

About you

• You bring 5+ years of experience in Data Engineering, with expertise in Data Platforms, Data Modeling, and building production-grade data pipelines. You have strong Python and SQL skills and know how to translate business requirements into scalable technical solutions.
• You have experience designing and supporting distributed data processing systems such as Apache Spark, Flink, or Beam, and are comfortable working with large-scale datasets, data lakes, data warehouses, and ETL/ELT architectures across Azure, AWS, or GCP.
• You have a solid understanding of scalable system design, data engineering best practices, and modern Lakehouse technologies such as Apache Delta, Iceberg, and Hudi.
• Experience with Snowflake, DBT, Docker, Kubernetes, workflow orchestration tools such as Dagster, Airflow, or NiFi, and CI/CD pipelines is highly valued.
• You have worked with both relational databases (PostgreSQL, SQL Server, Oracle) and NoSQL databases such as HBase or Cassandra, and understand DevOps principles and automated deployment practices.
• You combine strong problem-solving skills, ownership, and a consultative mindset with the ability to work independently and confidently in complex, fast-paced environments.

About your Benefits

In order to provide our employees with the best possible support for their individual needs, we offer a wide range of benefits:

• Work from Home: If your job does not require you to be present in the office, we can arrange the place you work from individually - even for up to 20 days a year anywhere in the EU.
• Redcare events: We promote teambuilding through creative team events, and celebrate our successes together at regularly scheduled parties.
• Kindergarten Grant: We offer our employees who pay for childcare in kindergarten 100,00 € (total) per month.
• Mental health: Get quick professional help from psychologists from nilo if you feel overwhelmed in your personal or professional life. Anonymously and free of charge.
• Personal Development: We are all constantly learning. That's why we support and foster your career development through internal & external training and help you grow.
• Mobility: Your commute matters to us. We provide our employees with a fully costed Deutschland Ticket which can be used at any time.
• Sports & Health: Your well-being is our top priority. Therefore, we offer you a range of opportunities to improve your health. Profit from a membership (M) package at Urban Sports Club, providing a variety of sports offers tailored to your interests.

While this is a remote position based in Germany, it may require occasional on-site collaboration at our offices in Berlin or Cologne, depending on business and team requirements.