Data Migration Strategy from Hadoop to Google Cloud

This document is a case study detailing Scotiabank's strategy for migrating data from Hadoop to Google Cloud. The objective of the migration is to unlock advanced analytics capabilities while ensuring the integrity and performance of the existing Hadoop infrastructure. The bank faced challenges in adopting a big bang approach due to the need for comprehensive analysis of applications and workloads, leading to a phased migration strategy. Initially, Scotiabank considered using the DistCp utility for data transfer but determined it would impose unacceptable overhead on their already strained resources. As a solution, Cirata Data Migrator was selected for its ability to handle petabyte-scale data movement without disrupting business operations. The results of implementing Data Migrator included significant time savings in the migration process, reduced resource requirements, and lower costs and risks associated with the project. Additionally, the migration facilitated faster access to Google analytics and helped mitigate compliance risks in the banking sector.