Paper Title: Getting the Most Out of QLC-based NVMe Storage

Paper Abstract: As a high-profile storage offering, QLC-based NVMe storage devices offer performance advantages vs. HDD at an attractive price point, but its endurance is significantly less than other NVMe flash alternatives. We have developed technology adaptations to embrace QLC despite it being less robust than other NVMe flash, making certain that data durability will not be compromised and data access will not be interrupted. Small writes would be especially fatiguing to QLC, reducing its longevity while also not yielding optimal performance. With a tiered solution, incoming data is initially written to TLC, and then small Writes are repackaged together so that only large write operations are exposed to the QLC layer of the storage architecture. We anticipate that as QLC NVMe devices grow in capacity, not only will the cost per GB be reduced dramatically but also the consequences associated with the failure of such a device will become more significant. We can demonstrate systems with HA (High Availability) capabilities such that large-capacity NVMe devices can optionally be deployed in pairs for non-disruptive continuous operation in the event of hardware failures.

Paper Author: Andy Watson, Startup Strategy, AWS

Author Bio: Andy Watson has focused on the customer experience of high-performance file storage since 1991. At Auspex Systems he worked closely with early adopters of those first purpose-built NFS file servers. Then at NetApp from 1995 (becoming the company’s second CTO in 1998), Andy led cross-functional teams to integrate multiprotocol file server appliances into increasingly complex environments as diverse as Oracle dbms and Rocketmail (the precursor to all webmail), or spanning the spectrum from SAP production environments to seismic analysis applications for the energy sector. Most recently as CTO at Minio, with its cloud-native open source object storage software, Andy has confronted cloud-vs-on-premises decisions and the challenges of digital transformation. As WekaIO’s CTO, Andy will continue to actively engage with customers and partners. It’s the best way to track emerging trends and to bring actionable feedback to Engineering and Product Management. Andy has a Bachelor’s degree (majoring in Physics) from Bard College.