Data Engineer | London, UK

Role Summary

We are looking for experienced Data Engineers / Data Analysts to support a ledger migration and data clean-up initiative across the data lake, reporting and downstream feeds. The role will involve working on large-scale batch processing, data validation, regression testing and migration readiness activities within a financial services environment.

Key Responsibilities

• Support ledger migration activities, including data extraction, transformation, reconciliation and validation.
• Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds.
• Develop, enhance and validate SQL queries, batch jobs and data processing logic.
• Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration.
• Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues.
• Document data mapping, validation rules, test results and migration exceptions clearly.
• Support production readiness, defect triage and post-migration validation activities.

Required Skills and Experience

• Strong hands-on experience with SQL and data analysis across large datasets.
• Experience with batch processing, batch regression testing and data reconciliation.
• Working knowledge of Spark or similar distributed data processing technologies.
• Experience working with data lakes, reporting platforms, feeds and data migration programmes.
• Ability to identify data inconsistencies, investigate root causes and support remediation.
• Strong understanding of data quality, controls, validation and auditability in enterprise environments.
• Good communication skills with the ability to work across engineering, business and product stakeholders.

Preferred Experience

• Prior experience in financial services, banking, ledger systems or regulatory data environments.
• Experience supporting enterprise-scale migration, modernisation or platform transformation programmes.
• Exposure to reporting, dashboards, data views and operational data feeds.
• Ability to work in distributed teams across London, Bangalore and Singapore.