DAOS: Revolutionizing Distributed Storage with Non-Volatile Memory
TimeWednesday, 20 November 201911:30am - 12pm
DescriptionThis session will introduce the architecture and performance of Distributed Asynchronous Object Storage (DAOS), an open-source software-defined multi-tenant scale-out object store designed to take advantage of next generation Non-Volatile Memory (NVM) technology to address the increasing needs of hyperconverged HPC (AI, Data Analytics, and traditional HPC). Storage Class Memory (SCM), such as Intel’s Optane DC Persistent Memory (DCPMM), offers applications byte-granular storage at higher bandwidths, lower latencies, and higher IOPs than solid state block storage devices alone. DAOS stores its metadata and fine-grained application data to Optane DCPMM, and bulk data to NVMe storage (e.g. Optane or 3D-NAND SSDs). In addition, DAOS provides transactional non-blocking I/O, OS bypass, advanced data protection with self-healing, end-to-end data integrity, fine grained data control, and fast data retrieval/indexing. DAOS offers a unified storage model over domain-specific data models, such as HDF5, MPI-IO and Apache Spark, while supporting legacy applications through a POSIX emulation layer.