Storage Developer Conference

RDMA-enabled storage protocols (including SMB3, NFSv4, NVMe over Fabrics, etc), and RDMA protocols (RoCE, iWARP, Infiniband, etc) are being extended to enable remote access to Persistent Memory. Data access at ultra-low remote latency, with high fidelity to local semantics, are goals which are well within reach. Beyond the data itself, can other aspects of storage, such as security and data integrity, be addressed with similar network-based solutions, without upper-layer or CPU interaction? What additional types of protocol extensions might be envisioned to provide similar latency and offload benefits from storage and network adapters, for these other important storage attributes? This talk will explore the landscape of existing protocol-based access to Persistent Memory, and prioritize additional requirements which merit consideration. It will present a set of architectural tools, with practical protocol implementation approaches, to extend the benefits of RDMA to a broader range of storage solutions based

In this presentation, we introduce accelerated NVMe over fabrics (NVMe-oF) target and host solutions with SPDK (storage performance development kit) library. SPDK vhost is a userspace target designed to extend the performance efficiencies of SPDK into QEMU/KVM virtualization environments. Compared with existing kernel based vhost solutions, SPDK vhost target provides up to 10x better performance and/or efficiency while enabling significantly lower latency when used with Intel Optane media. Using both SPDK based NVMe-oF target and host, the round trip latency of single I/O can be reduced to 50% compared the total solution provided by Linux kernel. This session covers the performance of SPDK vhost target, design principles for CPU efficiency, usage models and future plans.

Linux gained the first publicly release driver for the then new NVM Express standard in early 2011. It went through a lot of changes since then, including the move the new blk-mq block driver infrastructure, the addition of NVMe over Fabrics support including the split of the driver into a common core and transport drivers and the addition of lots of feature since then. This talk starts by explaining the historic development of the Linux NVMe driver including it’s influence on common Linux code and then presents the current new features and developments including power management, host memory buffer support, adaptive I/O polling support and the latest and greatest in Fabrics including multipathing support.

This talk will explore new capabilities that are proposed to be added to SMB3 for supporting emerging scenarios like containers, direct-access filesystem (DAX ) and large scale-out clusters with affinitized storage. Containerized workloads accessing data hosted on a remote share typically authenticate to the remote resource using the identity of the container or a pre-plumbed credential setup by an administrator. We explore “identity tunneling” extensions to the protocol to allow applications to tunnel their identity to the server on top of an existing authenticated SMB session. Direct access storage (Storage Class Memory (SCM) /Persistent Memory (PM)) is now being deployed in more and more scenarios where low-latency IO is required. SMBDirect/RDMA provides a mechanism for clients to directly access DAX storage on a server. We will look at various approaches to accessing DAX storage – first via the existing SMB3 protocol and potential enhancements to mostly bypass the software stack on the client and server

While the “perfect” workload to test an array for a customer is the workload or combination that will run against the array in production, enterprises and vendors benefit greatly from a workload approach that more accurately models a production workload to be executed against an array. Enterprises benefit by seeing the characteristics of their own workload or combination, while vendors benefit by being able to scale emulated workloads to array limits and better able to deal with performance issues that occur only after an array is released. Spatial locality, temporal locality emulating application “burstiness” ensure no array is unrealistically penalized nor given a “free pass” because a test does not reflect the application behavior that will be seen in production. This is a non-trivial exercise. New approaches use storage controller performance measurement or wire data to derive application workload models that make it possible to test how an application or application combination affects array performanc

Persistent memory NVDIMMs create security challenges, some of which are familiar while others are new. The NVM Programming TWG has been working on a security threat model for Persistent Memory that exposes gaps where solutions need to evolve beyond those that met the needs of hard disks and SSD’s. This session describes the current work in progress of the TWG that will appear in a future white paper. Learning Objectives: 1)Learn what how persistent memory security solutions may differ from hard disk and SSD solutions; 2)Learn how multi-tenancy in a cloud datacenter relates to Persistent Memory security features; 3)Show how protection of data at rest can facilitate secure reuse of NVDIMMs.

The SNIA NVM Programming model enables applications to consume emerging persistent memory technologies through step-wise evolution to greater and greater value. Starting with an overview of the recently released revision of the NVM programming model specification version 1.2, this session summarizes the changes and the continuing work of the NVM programming TWG in areas of high availability and security. We take an application view of ongoing technical innovation in a persistent memory ecosystem. Learning Objectives: 1) Learn about the exciting things happening in the SNIA NVM programming TWG; 2)Get an overview of several key topics of the SNIA NVM Programming Model; 3)Learn about the resources available to help developers plan and implement persistent memory aware software.

NVMe is one of the most interesting new developments to happen to storage in the past several years, and NVMe over Fabrics extends these capabilities over a Storage Area Network. Given that 80% of all existing Flash storage solutions deployed are interconnected with Fibre Channel (FC), many questions have arisen about what it is, how it works, and why someone might want to consider using Fibre Channel for NVMe-based solutions. Learning Objectives: 1)How does Fibre Channel and NVMe work together?; 2)How is NVMe over Fabrics different from “traditional” Fibre Channel?; 3)What changes do I have to make to my Fibre Channel environment in order to get NVMe over Fabrics to work?; 4)What would an NVMe over Fibre Channel (FC-NVMe) architecture look like?; 5)What advantages would I get using Fibre Channel in an NVMe solution?

The industry needs a protocol that provides efficient storage operations for both data centers and hyperscale applications. Data centers are willing to pay more for more complex interfaces that provide reliable data response times, while Hyperscalers want the lowest cost and greatest flexibility to optimize their cost/performance ratios. Two paths are under consideration to provide deterministic read latency. One is I/O determinism in which the host controls the timing of reads vs. writes to storage elements specified by the controller. This approach requires complex controller firmware leading to highly capable but possibly more expensive controllers. Data centers find this to be easy to install and manage. The other path is Open Channel (Open Fabrics Alliance) where the controller provides information about the physical characteristics of the storage device (e.g., channel and die layout) and the host determines the physical location that data is stored on the medium. Hyperscalers believe this allows them to

The implementation of SMB3 is a broad and important set of topics on the Samba roadmap. After a longer period of preparations, the first and the most generally useful of the advanced SMB3 features has recently arrived in Samba: Multi-Channel. This presentation will explain Samba's implementation of Multi-Channel, especially covering the challenges that had to be solved for integration with Samba's traditional clustering with CTDB, which is invisible to the SMB clients and hence quite different from the clustering built into SMB3. Afterwards an outlook will be given on other areas of active development like persistent file handles, RDMA, and scale-out SMB clustering, reporting on status and challenges.

Samba is used on a wide variety of local file systems, but it can also be used on cluster filesystems and now on NFS. This presentation will describe our experiences running Samba on NFS, with Samba as a gateway to pNFS storage, and the ways to best integrate the two protocols on Linux when run in this configuration. The presentation will discuss how ACLs and SMB3 specific metadata can be handled, as well as some performance considerations.

A new class of ultra low latency remote storage is emerging - nonvolatile memory technology can be accessed remotely via high performance storage protocols such as SMB3, over high performance interconnects such as RDMA. A new ecosystem is emerging to "light up" this access end-to-end. This presentation will explore one path to achieve it, with performance data on current approaches, analysis of the overheads, and finally the expectation with simple extensions to well-established protocols. Learning Objectives: 1) Understand the potential for low latency remote storage; 2) Survey the protocols and interfaces in use today; 3) See current performance data, and future performance expectations; 4) See a view of the future of the end-to-end storage revolution.

NVMe SSDs are becoming increasingly popular choice in scale out storage for latency sensitive workloads like databases, real time analytics, video streaming. NVMe SSDs provide significant performance throughput and lower latency compared to SATA, SAS SSDs. It is not unrealistic to expect these devices providing close to million random IOs per second. However scale out software stacks have significant amount of software overhead limiting the immense potential of NVMe SSDs. In this session, we present all flash scale out cluster performance, analysis on data path I/O overhead and programming techniques to systemically address software performance barriers. Learning Objectives: 1) Scale out storage software data path flows; 2) Performance profiling with NVMe SSDs; 3) User mode v/s kernel mode NVMe SSD integration; 4) Optimization techniques.

Designed to meet the expectations of end users for simple, modern and secure management of scalable platform hardware, the DMTF’s Redfish is an open industry standard specification and schema that specifies a RESTful interface and utilizes JSON and OData to help customers integrate solutions within their existing tool chains. This session provides an overview of the Redfish specification, including the base storage models and infrastructure that are used by the SNIA Swordfish extensions (see separate sessions for details). We will cover details of the Redfish approach, as well as information about the new PCIe and memory models added to support storage use cases. Learning Objectives: 1) Introduction to Redfish concepts; 2) Application of REST APIs to standards management.

While originally designed for disk drives, the read/write I/O model has provided a common storage abstraction for decades, regardless of the type of storage medium. Devices are becoming increasingly complex, however, and the constraints of the old model have compelled the standards bodies to develop specialized interfaces such as the Object Storage Device and the Zoned Block Commands protocols to effectively manage the storage. While these protocols have their place for certain workloads, there are thousands of filesystems and applications that depend heavily on the old model. It is therefore compelling to explore how the read/write mechanism can be augmented using hints and stream identifiers to communicate additional information that enables the storage to make better decisions. The proposed model is applicable to all types of storage devices and alleviates some of the common deficiencies with NAND flash and Shingled Magnetic Recording which both require careful staging of writes to media.

Cloud block storage implementations, such as Ceph RADOS Block Device (RBD) and Microsoft Azure Page Blobs, are considered flexible, reliable and relatively performant. Exposing these implementations for access via an embedded USB storage gadget can solve a number of factors limiting adoption, namely: Interoperability - Cloud storage can now be consumed by almost any system with a USB port Ease of use - Configure once, then plug and play Security - Encryption can be performed on the USB device itself, reducing reliance on cloud storage providers This presentation will introduce and demonstrate a USB cloud storage gateway prototype developed during SUSE Hack Week, running on an embedded Linux ARM board. Learning Objectives: 1) Knowledge of existing Ceph and Azure block storage implementations; 2) Awareness of problems limiting cloud storage adoption; 3) Evaluate a USB cloud storage gateway device as a solution for factors limiting adoption.

The SPEC SFS subcommittee is currently finalizing an industry-standard workload that simulates the storage access patterns of large-scale EDA environments. This workload is based upon dozens of traces from production environments at dozens of companies, and it will be available as an addition to the SPEC SFS benchmark suite. Join us to learn more about the storage characteristics of real EDA environments, how we implemented the EDA workload in the SPEC SFS benchmark, and how this workload can help you evaluate the performance of storage solutions.

Cloud computing frameworks like Kubernetes are designed to address containerized application management using "service" level abstraction for delivering smart data center manageability. Storage management intelligence and interfaces need to evolve to support "service" oriented abstraction. Having every computing framework reinvent the storage integration makes the storage management more complex from end user perspective. Moreover it adds significant burden on storage vendors to write drivers and certify for every orchestration stack which is least desirable. In this session, we present industry wide effort to develop unified storage management interfaces that work across traditional and cloud computing frameworks and eliminate the need to reinvent storage integration. Learning Objectives: 1) Storage integration in container frameworks; 2) Unified storage management interface; 3) Open source community work.

BetrFS is a new file system that outperforms conventional file systems by orders of magnitude on several fundamental operations, such as random writes, recursive directory traversals, and metadata updates, while matching them on other operations, such as sequential I/O, file and directory renames, and deletions. BetrFS overcomes the classic trade-off between random-write performance and sequential-scan performance by using new "write-optimized" data structures. This talk explains how BetrFS's design overcomes multiple file-system design trade-offs and how it exploits the performance strengths of write-optimized data structures.

NVMe is catching fire in the market and after years of incubation it is poised to become a major player in server, storage and networking implementations. In this session, G2M Research will discuss the development, deployment models, uses cases and market opportunity for NVMe across enterprise, Telco, Cloud, IoT and embedded applications. NVMe will be used for more than just accelerating SSD, it will become a major player in new computing models for compute, fabrics, analytics, application acceleration, systems management and more. Come see how NVMe will evolve and be used in more ways than you ever thought possible.