Inside the Cloud: A Deep Dive into Cold Data Archiving

Abstract

Cold data holds significant value for regulatory compliance, audits, legal necessities, and disaster recovery, even though it's not frequently accessed. Archiving is a strategic approach that enables businesses to manage this data efficiently, balancing cost, scalability, and performance. This presentation will highlight key features of leading cloud-based archival systems like AWS S3/Glacier, Azure Archive Storage, Google Cloud Storage, etc. We’ll delve into asynchronous data access on archives and the role of staging data in this process. Later we will go into intricacies of building an enterprise level archival system and the role of metadata stores on distributed archival storage. Furthermore, we'll confront challenges such as ensuring data integrity and durability, continuous repair services, and managing system boundaries. Join this session for valuable insights into archival strategies, distributed systems, and cloud storage.

Related Sessions