For some time, LINSTOR has been able to use NVMe-oF storage targets via the Swordfish API. This was expressed in LINSTOR as a resource definition that contains a single resource with one backing disk (that is the NVMe-oF target) and one diskless resource (that is the NVMe-oF initiator).
Layers in the storage stack
In the last few months the team has been busy making LINSTOR more generic, adding support for resource templates. A resource template describes a storage stack in terms of layers for specific resources/volumes. Here are some examples of such storage stacks:
- DRBD on top of logic volumes (LVM)
- DRBD on top of zVols (ZFS)
- Swordfish initiator & target on top of logic volumes (LVM)
- DRBD on top of LUKS on top of logic volumes (LVM)
- LVM only
The team came up with an elegant approach which introduces these additional resource templates in ways that existing LINSTOR configurations keep their semantics as the default resource templates..
With this decoupling, we no longer need to have DRBD installed on LINSTOR clusters that do not require the replication functions of DRBD.
What does that mean for DRBD?
The interests of LINBIT’s customers vary widely. Some want to use LINSTOR without DRBD – this is now supported. A very prominent example for this category is Intel, who uses LINSTOR in its Rack Scale Design effort to connect storage nodes and compute nodes with NVMe-oF. In this example, the storage is disaggregated from the other nodes.
Other customers see converged architectures as a better fit. For converged scenarios, DRBD has many advantages over a pure data access protocol such as NVMe-oF. LINSTOR is built from the ground up to manage DRBD, as such DRBD support will remain.
Linux native NVMe-oF and NVMe/TCP
SNIA’s Swordfish has clear benefits with creating a standard for managing storage targets such as allowing optimized storage target implementations as well as a hardware-accelerated data-path, non-Linux control path.
Due to the fact that Swordfish is an extension of Redfish, which needs be implemented in the BMC (Baseboard Management Controller), we have decided to extend LINSTOR’s driver set to configure NVMe-oF target and initiator software. We do this by utilizing existing tools found within the Linux operating system, eliminating the need for a Swordfish software stack.
LINSTOR now supports configurations without DRBD. It is now a unified storage orchestrator for replicated and non-replicated storage.