Paper Title: Cloud Storage Optimization using Compression & Deduplication

Paper Abstract: There are currently exabytes of cloud storage and this is growing exponentially. Companies pay billions of dollars to store and retrieve data. In this talk, we will cover some of the space and time optimizations, which have historically been applied to on-premise file storage, and discuss how they are applied to objects stored in the Cloud Deduplication and compression are techniques that have been traditionally used to reduce the amount of storage used by applications. Data encryption is table stakes for any remote storage offering and today, we have client-side and server-side encryption support by Cloud providers. Combining compression, encryption, and deduplication for object stores in ther Cloud is challenging due to the nature of overwrites and versioning, but the right strategy can save millions of dollars for an organization. We will cover some strategies for employing these techniques depending on whether an organization prefers client side or server side encryption, and discuss online and offline deduplication of objects. Companies such as Box, and Netflix, employ a subset of these techniques to reduce their cloud footprint and provide agility in their cloud operations.

Paper Author: Tejas Chopra, Sr. Software Engineer, Netflix

Author Bio: Tejas Chopra is a Sr. Software Engineer at Netflix, where he works on the Storage infrastructure for Netflix Studios. He is a TedX and an international keynote speaker with talks on Blockchain, Storage, Web3.0, Cloud computing, and Engineering culture. He has over a decade of experience working on distributed systems, and has a Masters in Electrical and Computer Engineering from Carnegie Mellon University.