Artykuł w czasopiśmie
Brak miniatury
Licencja

ClosedAccessDostęp zamknięty
 

InftyDedup: Scalable and Cost-Effective Cloud Tiering with Deduplication

Uproszczony widok
dc.abstract.enCloud tiering is the process of moving selected data from on-premise storage to the cloud, which has recently become important for backup solutions. As subsequent backups usually contain repeating data, deduplication in cloud tiering can significantly reduce cloud storage utilization, and hence costs. In this paper, we introduce InftyDedup, a novel system for cloud tiering with deduplication. Unlike existing solutions, it maximizes scalability by utilizing cloud services not only for storage but also for computation. Following a distributed batch approach with dynamically assigned cloud computation resources, InftyDedup can deduplicate multi-petabyte backups from multiple sources at costs on the order of a couple of dollars. Moreover, by selecting between hot and cold cloud storage based on the characteristics of each data chunk, our solution further reduces the overall costs by up to 26%-44%. InftyDedup is implemented in a state-of-the-art commercial backup system and evaluated in the cloud of a hyperscaler.
dc.affiliationUniwersytet Warszawski
dc.conference.countryStany Zjednoczone
dc.conference.datefinish2023-02-23
dc.conference.datestart2023-02-21
dc.conference.placeSanta Clara, CA
dc.conference.seriesConference on File and Storage Technologies
dc.conference.seriesConference on File and Storage Technologies
dc.conference.seriesshortcutFAST
dc.conference.shortcutFAST '23
dc.conference.weblinkhttps://www.usenix.org/conference/fast23
dc.contributor.authorIwanicki, Konrad
dc.contributor.authorDubnicki, Cezary
dc.contributor.authorWełnicki, Michał
dc.contributor.authorLichota, Krzysztof
dc.contributor.authorJackowski, Andrzej
dc.contributor.authorKotlarska, Iwona
dc.date.accessioned2024-01-25T04:14:34Z
dc.date.available2024-01-25T04:14:34Z
dc.date.issued2023
dc.description.financePublikacja bezkosztowa
dc.identifier.urihttps://repozytorium.uw.edu.pl//handle/item/109311
dc.identifier.weblinkhttps://dl.acm.org/doi/10.5555/3585938.3585941
dc.languageeng
dc.pbn.affiliationcomputer and information sciences
dc.relation.pages33-48
dc.rightsClosedAccess
dc.sciencecloudnosend
dc.titleInftyDedup: Scalable and Cost-Effective Cloud Tiering with Deduplication
dc.typeJournalArticle
dspace.entity.typePublication