DFKI
Synchronizing Disaggregated Data Structures with One-Sided RDMA
Pages
40
Time to read
110 mins
Publication
Language
English
Pages
40
Time to read
110 mins
Publication
Language
English
This technical report presents a comprehensive analysis of one-sided synchronization techniques used in disaggregated database management systems (DBMSs) that utilize Remote Direct Memory Access (RDMA). The report outlines the performance and scalability challenges associated with existing synchronization schemes, revealing that some do not correctly synchronize, leading to potential data corruption. The authors conduct experiments to demonstrate the impact of design choices on performance and propose general principles for achieving correct synchronization. The document also discusses the evolution of networking hardware, particularly focusing on modern 400G Network Interface Cards (NICs) and programmable switches, and how these advancements can address identified issues. The findings emphasize the importance of understanding low-level hardware details to ensure both correctness and efficiency in synchronization processes. Additionally, the report includes open-sourced benchmarks to facilitate the application of the findings across different hardware setups.