Paper Title: Achieving Scalable 5M+IOPS on NVMe/FC with Ultra Low Latency

Paper Abstract: The intent of this presentation is to go into the challenges of achieving scalable 5M+ IOPS on Storage with ultra low latency (~10uSec Round Trip). New workloads and Storage Class Memory (SCM) are demanding a new level of IOPs, bandwidth, and driver optimizations in Linux for storage networks. Will discuss hardware parallelization, per-core WQs, interrupt handling, and shared resource management that will benefit both SCSI and NVMe over Fabrics performance. Will show performance curves, discuss Linux OS issues encountered, and work yet to do in Linux to improve performance even more. I intend to go into architectural decisions in Hardware as well as Software that would enable us to scale along with multiple CPUs. Some comparisons with SCSI MQ scaling across sockets, bottlenecks in the driver and higher levels in the stack, interrupt and cpu affinity handling. Also, planning to compare running one or two real world applications on NVMe/FC and SCSI FCP. I am hoping I would be able to share results on the POC that we would be running with some major corporations. Other areas that I would like to cover are good practices in deployment and end to end congestion management.

Paper Author: Jayamohan Kallickal, Distinguished Engineer, Broadcom
Wenhua Liu, Staff 2 Engineer, VMware

Author Bio: Jayamohan is responsible for NVMe Over Fabrics project at Broadcom-ECD using NVMe/FC protocol on ESX. Primary responsibility is to architect, develop, test and deliver NVMe/FC product. Also, build an eco-system with VMware and NetApp. Responsible for performance tuning for raw IO as well as with applications. He has previous experience of 10 Years in iSCSI at Adaptec, ServerEngines and Emulex. Original author and Maintainer of be2iscsi driver in Linux Kernel. He has a Bachelor's of Technology (Electronics and Communication) from Government Engineering College, Thrissur, India and is currently pursuing Berkeley Executive Program in Management from UC Berkeley.

Author 2 Bio: Wenhua is the tech lead of NVMe over Fabrics device drivers development/integration for vSphere ESX at VMware. Primary responsibility is to architect, design and develop the NVMe device driver framework and NVMe/RDMA device driver for vSphere ESXi. Original author/developer of native ata driver for vSphere ESX at VMware. Original author/developer of SDD and SDDDSM for Windows at IBM. BS in Electronical Engineering from Fudan University, China and MS in Computer Application from East China Normal University, China.