NatWest Hadoop Data Lake Migration to AWS Cloud

This technical report outlines NatWest's strategy for migrating their on-premise Hadoop data lake to the AWS cloud. The objective of the migration is to leverage Sage analytics within the cloud environment. The report details the challenges faced during the migration, including the need to consolidate HIVE metadata into the Amazon Glue repository and the requirement for regulatory reporting applications to access data stored on-premises. Following a proof-of-concept, NatWest selected Cirata's Data Migrator for the data transfer process. The report describes how Data Migrator simplifies data integration, enabling automated and scalable data transfers between on-premises and cloud environments. It highlights the results achieved, including the optimization of data flow, the establishment of a standard data movement mechanism, and the successful transfer of 1.4PB of data. Additionally, the report notes the increase in data science experiments and the integration of AI models across the bank, demonstrating the effectiveness of the migration strategy.