Skip to main content

Supermicro NVMesh Storage Solutions

Low-latency distributed block storage for web-scale data centers

Solution Overview

New application workloads are driving the need for new storage architectures: Cloud, Edge, AI and IoT bring new latency requirements – therefore companies need to rethink their storage strategies. 

Supermicro and Excelero have joined forces to deliver a high-performance, low-latency distributed block storage solution leveraging NVMe flash. The Supermicro NVMesh solution enables unmodified applications to utilize pooled NVMe storage devices across a network at local speeds and latencies. It was designed to combine virtually unlimited Supermicro servers with NVMe to scale capacity and performance.

NVMesh Diagram
NVMesh Diagram #2

Solution Key Benefits:

  • Maximize the utilization of your NVMe SSDs
  • Predictable application performance
  • Supports standard hardware & protocols
  • Use as block storage or with any file system
  • Easy to manage & monitor
Screenshot of NVMesh

Product Brief

The Supermicro NVMesh Reference Architecture implements the next-generation of intelligent infrastructure platforms designed to provide applications with all of the raw performance you can expect from local storage — and all of the flexibility, manageability and scalability typically experienced with traditional storage area network-based solutions. Leveraging the latest NVMe and PCIe standards, this reference architecture uses a low-latency, high-bandwidth networking to connect compute and storage together in a flexible way that will fit almost any application’s architecture requirements. Deploy this RA in storage-centric, compute-centric or mixed storage and compute configurations, and integrate it with existing data center application servers as desired.

NVMesh Product Brief

Supermicro NVMesh Reference Architecture

  BigTwin Server Ultra Server
Platform Form Factor 2U 4 nodes 2U 1node
Storage Media 24x 6.4 TB or 8 TB NVMe SSD devices 24x 6.4TB or 8TB NVMe SSD devices
CPU (two per node) Intel® Xeon® processor E5-2600 v4 family for X10 BigTwin
or
Intel® Xeon® Scalable Processors for X11 BigTwin
Intel® Xeon® processor E5-2600 v4 family for X10 Ultra
or
Intel® Xeon® Scalable Processors for X11 Ultra
Memory suggested 192GB DDR4 2666 per node suggested 192GB DDR4 2666 per node
Network up to 8 Mellanox ConnectX 5 VPI NIC up to 2 Mellanox Connect 5 VPI NIC
RAW Capacity up to 48TB per node (192TB per BigTwin) up to 192TB per node
Available Data Protection Fully Distributed RAID, enabling linear scale of performance and capacity
Infrastructure Support TCP/IP; RoCEv2; Infiniband
IOPs Performance up to 20M random 4k up to 5M random 4k
Throughput Performance up to 76GB/s up to 24GB/s
IO Latency Alike the local NVMe SSD Latency
Performance Density 38GB/s or 10M IOPs per RU 12GB/s or 2.5M IOPs per RU
Management CLI, GUI, REST API CLI, GUI, REST API
Operating System Support Linux
File System Support POSIX like as ext4 and xfs, plus GPFS, BeeGFS & Lustre
Excelero Software NVMesh Client
NVMesh Target
Available Excelero Service NVMesh 3y premium support
NVMesh Install Service, On-site
Available Supermicro Service 3-year onsite 24x7x4 service / 3-year onsite next business day service
Onsite Integration Services Onsite Survey Onsite logistics Racking & Cabling (with 3rd party switches) Racking & Cabling Engineering Drawing Releasing (Test included)

Certified Nodes for Supermicro NVMesh Reference Architecture

Supermicro EDSFF-Short (E1.S) Storage Server

A 100%, all NVMe flash storage server, optimized to efficiently serve petabyte-scale workloads with the low latency performance only available with Flash media. The Supermicro SuperStorage platform provides industry leading density in a 1U footprint. By offering 32+ hot-pluggable drives, petabyte-scale capacity can be achieved and enable an unprecedented combination of storage performance, density, efficiency and enterprise serviceability.

This combination optimizes IOPs per Watt which is ideal for transitioning capacity tiers of storage based on legacy HDDs to the benefits of all-flash NVMe SSDs. The system offers 32 E1.S drives with a proportionally shorter chassis depth.

E1.S Benefits

  • High density, thermal efficiency and hot-plug capability
  • EDSFF supports NVMe through PCIe Gen 3/4/5 up to 16 lanes
  • Hot-swappable and Power Loss Protection
  • Industry Recognized SSD form factor
  • Available in 4 TB capacity per drive
  • IOPS Intensive Storage App., DB App. (MySQL, Casandra), Hyper-converged Infrastructure / Scale-out Architectures
  • Dual Socket P (LGA 3647) support: 2nd Gen. Intel® Xeon® Scalable processors
  • 32 Hot-swap EDSFF Short drive bays
  • 24 DIMMs; up to 6TB 3DS ECC DDR4-2933 MHz RDIMM/LRDIMM
  • Supports Intel® Optane™ DCPMM*
  • 2 PCI-E 3.0 x16, 1 PCI-E 3.0 x4
  • 2x 10GBase-T ports via Intel X550, 1 Dedicated IPMI port
  • 1 VGA, 4 USB 3.0, 1 TPM header
  • 8x 4cm counter-rotating cooling fans
  • 1600W Redundant Titanium Level (96%) Power Supplies

*Contact your Supermicro sales rep for more info.

Supermicro NF1 Server

Supermicro in collaboration with Samsung has developed an extremely dense, very high capacity, all-flash storage server platform poised to revolutionize the industry with its price/performance and design efficiency. Using only one rack unit, it can house up to 576 TB of storage. The Samsung NF1 form factor was specifically designed to maximize performance and capacity for data intensive/low latency workloads. As a leader in Flash technology Samsung has created the NF1 form factor that has disrupted the storage industry with its reduced consumption of space and power.

The NF1 server starts with a no compromise motherboard featuring dual Intel™ Xeon™ Scalable processors up to 205W, which provide up to 56 cores, and 24 DIMMs for 3 TB of system memory. To achieve commercial success in both these application areas, the All-Flash platform must provide the lowest TCO, changing the decision from performance-at-all-cost, to a balance of price/performance and efficiency. The NF1 server strikes this balance perfectly.

NF1 Benefits

  • Easy to access and service with a front loading design
  • PCI-E 3.0 interface for up to 4 lanes
  • Compliant with NVMe 1.2 specifications
  • Hot-swappable and Power Loss Protection
  • 30.5 x 110mm, 4.38mm height
  • Available in 4-16TB capacities per drive
  • IOPS Intensive Storage App., DB App. (MySQL, Casandra), Hyperconverged Infrastructure / Scale-out Architectures
  • Dual Socket P (LGA 3647) support: 2nd Gen. Intel® Xeon® Scalable processors
  • 32 Hot-swap NF1 drive bays, 4 hybrid PCI-E NF1 or SATA3 M.2 drive bays
  • 24 DIMMs; up to 6TB 3DS ECC DDR4-2933 MHz RDIMM/LRDIMM
  • Supports Intel® Optane™ DCPMM*
  • 2 PCI-E 3.0 x16, 1 PCI-E 3.0 x4
  • 2x 10GBase-T ports via Intel X550, 1 Dedicated IPMI port
  • 1 VGA, 4 USB 3.0, 1 TPM header
  • 8x 4cm counter-rotating cooling fans
  • 1600W Redundant Titanium Level (96%) Power Supplies

*Contact your Supermicro sales rep for more info.

Supermicro BigTwin™

Supermicro BigTwin is the first and only 2U multi-node system supporting the highest performance processor, memory, storage, I/O and an incredible 30% better thermal capacity, leveraging the Titanium Level 96% efficient power supplies (2200W/2600W). The 5th generation of Supermicro's Twin architecture is fully optimized for today's diverse workloads and architected for further technology breakthroughs.

The system delivers the highest performance and efficiency in a 2U 4-node platform. It supports the widest TDP range of CPUs (up to 205W), fully exploits all memory channels with 24 DIMMS per node and 24 All-Flash NVMe drives. Finally, the Supermicro BigTwin provides 100% more I/O capacity and added flexibility with more than10 networking options including 1GbE, 10G, 25G, 100G, IB and industry leading SIOM modular interconnect.

BigTwin Benefits

  • A full range of processors up to the highest performance 205W CPUs
  • Maximum Memory Size with full 24 DIMMs of memory per node
  • 24 All-Flash NVMe or Hybrid Drives
  • Double the I/O Capacity with 4 hot-swappable nodes in a 2U form factor
BigTwin™ • 6 NVMe per Node • N+1 Cooling
  • 4 DP nodes in 2U; depth 28.75", Each Node:
  • Dual Socket P (LGA 3647) support: 2nd Gen. Intel® Xeon® Scalable processors; 3 UPI up to 10.4GT/s
  • 24 DIMMs; up to 6TB 3DS ECC DDR4-2933 MHz RDIMM/LRDIMM
  • Supports Intel® Optane™ DCPMM*
  • 6 Hot-swap 2.5" NVMe drive bays per node; 2 M.2 SATA3 or NVMe support
  • 2 PCI-E 3.0 x16 Low-profile slots, 1 Networking SIOM card support
  • 1 Dedicated IPMI port, 1 VGA, 2 USB 3.0, 1 SuperDOM
  • 16 Heavy duty 40x56mm fans w/ optimal fan speed control (4 fans per node)
  • 2600W Redundant Titanium Level (96%) Power Supplies

*Contact your Supermicro sales rep for more info.

24 NVMe support • 6 NVMe per Node
  • 4 DP nodes in 2U; depth 28.75", Each Node:
  • Dual Socket R3 (LGA 2011) support: Intel® Xeon® processor E5-2600 v4/v3 family
  • 24 DIMM slots; up to 3TB ECC 3DS LRDIMM or RDIMM DDR4-2400MHz
  • 2 PCI-E 3.0 x16 Low-profile slots, 1 Networking SIOM card support
  • At least one network card must be bundled
  • 6 Hot-swap 2.5" NVMe drive bays per node
  • 1 Dedicated IPMI port, 1 VGA, 2 USB 3.0
  • System management: Built-in Server management tool (IPMI 2.0, KVM/media over LAN) with dedicated LAN port
  • 4 heavy duty 80mm fans w/ optimal fan speed control
  • 2200W Redundant Titanium Level (96%) High-efficiency Power Supplies

Supermicro A+ server with integrated system cooling fans designed for an ultra-dense multi-node infrastructure in a compact package for up to 2600-watt power delivery at Titanium Level (96%) efficiency, the enabling technology for the BigTwin to support AMD EPYC™ processors with up to 16 DIMM slots per node. The BigTwin reduces power consumption with shared cooling and power design, leveraging redundant high efficiency power supplies.

2U 4 Nodes; Each node:

  • Dual AMD EPYC™ 7000-series processors supported (Socket SP3) 
  • Supports up to 2TB Registered ECC DDR4 2666MHz SDRAM in  16 DIMMs
  • 1 M.2, 6 hot-swap 2.5" NVMe drive bays
  • 2 PCI-E 3.0 x16 Low-profile slots, 1 Networking SIOM card support  (optional; must bundle with at least one SIOM network card)
  • IPMI 2.0 + KVM with dedicated LAN support, 1 VGA, 2 USB 3.0, 1 SuperDOM
  • 2600W Titanium level Redundant Power Supplies with PMBus

Supermicro Ultra

Supermicro Ultra Servers are designed to deliver the highest performance, flexibility, scalability and serviceability to demanding IT environments, and to power mission-critical Enterprise workloads. With Redundant Titanium Level (96%+) Power Supplies (1600W), Supermicro Ultra Servers are able to provide green computing solutions to our customers while delivering unrivaled performance, flexibility, scalability, and serviceability for demanding Enterprise workloads.

Ultra SuperServers support up to: 3TB DDR4 2666MHz in 24 DIMMs; SATA3 with optional SAS3 and NVMe support for increased storage bandwidth; a variety of Ultra Riser options, including built-in 1G, 10GBASE-T, 10G SFP+, and 25G Ethernet options; support for add-on SAS 3 HW/SW RAID controllers and additional PCI-E 3.0 slots. Supermicro Ultra Servers is the best fit for diverse workloads and applications and can be easily reconfigured for multiple Enterprise and Data Center applications in Virtualization, Big Data, Analytics and Cloud Computing.

Ultra Benefits

  • Support for new generation X11 Solutions with Dual Intel® Xeon® Scalable processor up to 205W
  • Up to 3TB DDR4 2666MHz in 24 DIMM slots
  • 100/40/25/10G Ethernet
  • NVMe/SAS3/SATA3 Drive Bays
  • Up to 8/4 PCI-E 3.0 Expansion Slots
  • Redundant Titanium Level (96%+) Power Supplies
24 NVMe support • 4x 10GBase-T
  • Virtualization Hosting, Cloud Computing, Data Center
  • Dual Socket P (LGA 3647) support: 2nd Gen. Intel® Xeon® Scalable processors; dual UPI up to 10.4GT/s
  • 24 DIMMs; up to 6TB 3DS ECC DDR4-2933 MHz RDIMM/LRDIMM
  • Supports Intel® Optane™ DCPMM*
  • 24 Hot-swap 2.5" drive bays; 24 NVMe (4 hybrid ports - SAS3 via AOC), 2 rear Hot-swap 2.5" drive bays; 2 internal M.2 (1 SATA3, 1 NVMe)
  • 2 PCI-E 3.0 x16 (FH, 10.5" L), 1 PCI-E 3.0 x8 (LP)
  • 4x 10GBase-T ports, 1 Dedicated IPMI port
  • 2 VGA (1 rear, 1 onboard), 1 Serial, 3 USB 3.0 (2 rear, 1 Type A)
  • 4 heavy duty 8cm PWM fans
  • 1600W Redundant Titanium Level (96%) Power Supplies

*Contact your Supermicro sales rep for more info.

24 NVMe support • 4x 10GBase-T
  • Virtualization Hosting, Cloud Computing, Data Center
  • Dual Socket R3 (LGA 2011) support: Intel® Xeon® processor E5-2600 v4/v3 family; QPI up to 9.6GT/s
  • 24 Hot-swap 2.5" NVMe bays (4 hybrid ports - optional SAS3 support via AOC); 2x 2.5" Hot-swap SATA3 drive bays (rear)
  • 24 DIMM slots; up to 3TB ECC 3DS LRDIMM or RDIMM DDR4-2400
  • 2 PCI-E 3.0 x16 slots (FH 10.5" L), 1 PCI-E 3.0 x8 (LP) slot
  • 4x 10GBase-T ports, 1 dedicated IPMI, 1 Video, 1 COM, 5 USB 3.0 (2 rear, 2 via header, 1 Type A)
  • System management: Server management tool (IPMI 2.0, Virtual Media over LAN) with dedicated LAN port
  • 4x 80mm heavy duty PWM fans
  • 1600W Redundant Titanium Level (96%) Power Supplies

Certified Networking Adapters

AOC-MCX556A-ECAT
AOC-MCX556A-ECAT
  • Standard Low-profile Mellanox EDR IB (100Gb/s) and 100GbE card with 2 QSFP28 ports
  • Interface: PCI-E 3.0 x16
  • Port: 2 QSFP28 ports
  • Speed: 100Gb IB or 100GbE per port