Improving Data Quality Through the Medallion Architecture

This technical report details the implementation of a Medallion Architecture by Kythera Labs aimed at enhancing the quality of healthcare Real-World Data (RWD). The architecture consists of four layers: Bronze, Silver, Gold, and Platinum. The Bronze layer serves as the initial stage where data from various sources is collected without alterations. The Silver layer involves a 'remastering' process that includes data cleaning, matching, and standardization, allowing users to confidently utilize the data. The Gold layer organizes this refined data into consumption-ready analytics for various applications such as customer analytics and market intelligence. Finally, the Platinum layer provides immediate access to these analytics through a user-friendly SQL interface, enabling clients to analyze large datasets efficiently. The report emphasizes the importance of data quality in healthcare and outlines the processes involved in transforming raw data into valuable insights, ensuring that clients can quickly address their business questions without navigating complex data quality issues.