Skip to main content

SuperBlade® – Networking

The 8U SuperBlade® networking options include four different Ethernet modules. For simple Layer 2 switching at 1-Gbps the MBM-GEM-004 and MBM-GEM-001 switch offers a cost-effective connectivity option for 20-Blade systems.

Access to 10-Gigabit Ethernet networks is provided by either the Layer 2/3 1/10-Gbps Ethernet Switches – MBM-XEM-002 and MBM-XEM-001 (up to 20 Blades).

For even faster connections, Supermicro offers two different connectivity options. A new InfiniBand switch based on EDR technology – SBM-IBS-E3616 provides connection from Blades to EDR (100G) InfiniBand networks. And other solution is based on Intel’s Omni-Path Architecture with 100G connectivity to the servers with SBM-OPA-C4020.
All SuperBlade® networking options are hot-pluggable.

Product Brief

 
Ethernet Modules

25G Modules

Switches

 

Gbit Ethernet Switch
SBM-25G-100
 
General Specifications
  • 20x 25G Ethernet downlink (backward compatible to 20x10G)
  • 4x 100G/40G Ethernet uplinks, each can split into 4x 25G or 4x 10G uplinks with optional fan-out cables
  • 1x Gigabit Ethernet uplink
  • 1 console port
Switching Capacity
  • 1800Gbps
Physical Layer Features
  • 100G/40G optical/copper QSFP28
  • Gigabit Ethernet copper RJ45
Layer 2 Features
  • 4K VLANs
  • Spanning Tree Protocol (802.1D)
  • Rapid Spanning Tree Protocol (802.1w)
  • IEEE 802.lQ VLANs/ port-based VLANs
  • Multiple Spanning Tree Protocol (802.1s)
  • Jumbo frames up to 9KB
  • IEEE 802.1AX LAG
  • IEEE 802.3ac VLAN tagging
  • IEEE 802.1AB Link Layer Discovery Protocol (LLDP)
Security Features
  • Switch access password protection
  • RADIUS and TACACS+ Authentication
  • Access Control Lists
  • SSH, SSL Encryption
  • DHCP Snooping
System Management
  • Industry Standard CLI
  • Web-based management interface – HTTP/HTTPS
  • Syslog
  • SSH
  • SNMP v1/v2/v3
  • NTP
  • Content-sensitive "Help"
  • Auto Command completion
  • TFTP Client
  • XML-RPC
  • Blade Network Manager (BNM)
Multicast
  • IGMP Snooping
Weight
  • 3.2lbs/1.5kg
Dimensions (W x D x H)
  • 267mm x 159mm x 36mm (10.5" x 6.25" x 1.4")
Download
  • Switch Configuration User's Guide [ Download ]

10GbE Modules

Switches

The 10 Gigabit Ethernet switch modules (part ID MBM-XEM-001 and MBM-XEM-002) include connection to the SuperBlade's LAN interfaces. While MBM-XEM-001 and MBM-XEM-002 connect to the LAN interfaces onboard the Blade servers. These are layer 2 / layer 3 Ethernet switching modules also have two internal Ethernet paths to the SuperBlade Chassis Management Module CMM(s) to allow configuration and management of the switch. Offering such advanced features as link aggregation, VLAN, Spanning Tree, Access Control Lists and Jumbo Frame support, the switches provide a connection between the Ethernet controllers integrated on the mainboard to the external Ethernet systems.

Gbit Ethernet Switch
MBM-XEM-002
 
General Specifications
  • Broadcom BCM56846 10GbE Low Latency Switch
  • 2x40Gbs QSP and 4x10Gbs uplinks*
  • 20x 10/1Gbps downlinks
  • 1 Console port
  • 1 USB port
Switching Capacity
  • 1280Gbps
Physical Layer Features
  • Jumbo frames up to 9KB
  • 40 gigabit optical/copper
  • 10 gigabit optical Ethernet SFP+/copper
Layer 3 Features
  • BGP
  • OSPF
  • VRRP
Layer 2 Features
  • 4K VLANS
  • Spanning Tree (802.1D)
  • Rapid Spanning Tree (802.1w)
  • Multiple Spanning Trees (802.1s)
  • IEEE 802.lQ VLANs/ port-based VLANs
  • IEEE 802.3ad with LACP
  • IEEE 802.1AB Link Layer Discovery Protocol (LLDP)
Advanced Layer 2 Features
  • Storm control
  • Flow control
  • Port mirroring
  • MLAG
Security Features
  • Switch access password protection
  • RADIUS and TACACS+ Authentication
  • Access Control Lists
  • SSH, SSL Encryption
  • DHCP Snooping
System Management
  • Industry Standard CLI
  • Command Completion
  • Context Sensitive Help
  • SNMP v1/v2/v3
  • SSH
  • Syslog
  • DHCP (Client)
  • Web-based management interface
  • NTP
  • RMON
  • Blade Network Manager (BNM)
Multicast
  • IGMP Snooping
Weight
  • 3.2lbs/1.5kg
Dimensions (W x D x H)
  • 267mm x 159mm x 36mm (10.5" x 6.25" x 1.4")
Download

* Supported with release 2.0.3-43
10Gbit Ethernet Switch
MBM-XEM-001
 
General Specifications
  • Intel® FM6348 10GbE Low Latency Switch
  • 4x 40Gbps QSFP uplinks
  • 20x 10/1Gbps downlinks
  • 1 Console port
  • 1 USB port
Switching Capacity
  • 960Gbps
Physical Layer Features
  • Jumbo frames up to 9KB
  • 40 gigabit optical/copper
  • 1 gigabit optical Ethernet copper
Layer 2 Features
  • 4K VLANS
  • Spanning Tree (802.1D)
  • Rapid Spanning Tree (802.1w)
  • Multiple Spanning Trees (802.1s)
  • IEEE 802.lQ VLANs/ port-based VLANs
  • IEEE 802.3ac VLAN tagging
  • IEEE 802.1AX LACP
  • IEEE 802.1AB Link Layer Discovery Protocol (LLDP)
Advanced Layer 2 Features
  • Storm control
  • Flow control
  • Port mirroring
  • Static MAC filtering
  • UDLD
  • Uplink Failure Detection (UFD)
Data Center Features
  • L2 Data Center Bridging
  • CEE v1.01 DCB for PFC/ETS
SDN
  • Open Flow 1.x
Security Features
  • Switch access password protection
  • RADIUS and TACACS+ Authentication
  • Access Control Lists
  • SSH, SSL Encryption
System Management
  • XML-RPC
  • Industry Standard CLI
  • Command completion
  • Context Sensitive Help
  • SNMP v1/v2/v3
  • SSH
  • TFTP Client
  • Syslog
  • DHCP (Client)
  • Web-based management interface - HTTP/HTTPS
  • NTP
Multicast
  • IGMP Snooping
Weight
  • 3.2lbs/1.5kg
Dimensions (W x D x H)
  • 267mm x 159mm x 36mm (10.5" x 6.25" x 1.4")
Download

Gigabit Ethernet Modules

Switches

The 1 Gigabit Ethernet switch modules (part ID MBM-GEM-004 and MBM-GEM-001) include connection to the SuperBlade's LAN interfaces. While MBM-GEM-001 and MBM-GEM-004 connect to the LAN interfaces onboard the Blade servers. These are layer 2 / layer 3 Ethernet switching modules also have two internal Ethernet paths to the SuperBlade Chassis Management Module CMM(s) to allow configuration and management of the switch.

Gbit Ethernet Switch
MBM-GEM-004
 
General Specifications
  • Broadcom BCM56151 1GbE Switch
  • 4x 10Gbps SFP+ and 8x 1Gbps RJ45 uplinks
  • 20x 1Gbps downlinks
  • 1 Console port
Switching Capacity
  • 176Gbps
Physical Layer Features
  • Jumbo frames up to 9KB
  • 10 gigabit optical Ethernet SFP+/copper
  • 1 gigabit RJ45 Ethernet
Layer 2 Features
  • 4K VLANS
  • Spanning Tree (802.1D)
  • Rapid Spanning Tree (802.1w)
  • Multiple Spanning Trees (802.1s)
  • IEEE 802.lQ VLANs/ port-based VLANs
  • IEEE 802.3ad with LACP
  • IEEE 802.1AB Link Layer Discovery Protocol (LLDP)
Advanced Layer 2 Features
  • Storm control
  • Flow control
  • Port mirroring
  • Uplink Failure Detection (UFD)
  • MLAG
Security Features
  • Switch access password protection
  • RADIUS and TACACS+ Authentication
  • Access Control Lists
  • SSH, SSL Encryption
  • Protected Ports
System Management
  • Industry Standard CLI
  • Context Sensitive Help
  • Command Completion
  • SNMP v1/v2/v3
  • SSH
  • Syslog
  • DHCP (Client)
  • Web-based management interface
  • NTP
  • RMON
  • Blade Network Manager (BNM)
Multicast
  • IGMP Snooping
Automation
  • Zero Touch Provisioning
Weight
  • 3.1lbs/1.4kg
Dimensions (W x D x H)
  • 267mm x 159mm x 36mm (10.5" x 6.25" x 1.4")
Download
Gbit Ethernet Switch
MBM-GEM-001
 
General Specifications
  • Intel® FM5224 GbE Low Latency Switch
  • 1Gbps RJ45, 2x 40Gbps QSFP or 8x 10Gbps SFP+ uplinks
  • 20x 1Gbps downlinks
  • 1 Console port
  • 1 USB port
Switching Capacity
  • 442Gbps
Physical Layer Features
  • Jumbo frames up to 9KB
  • 40 gigabit optical/copper
  • 10 gigabit optical/copper
  • 1 gigabit RJ45 Ethernet
Layer 2 Features
  • 4K VLANS
  • Spanning Tree (802.1D)
  • Rapid Spanning Tree (802.1w)
  • Multiple Spanning Trees (802.1s)
  • IEEE 802.lQ VLANs/ port-based VLANs
  • IEEE 802.3ac VLAN tagging
  • IEEE 802.1AX LACP
  • IEEE 802.1AB Link Layer Discovery Protocol (LLDP)
Advanced Layer 2 Features
  • Storm control
  • Flow control
  • Port mirroring
  • Static MAC filtering
  • UDLD
  • Uplink Failure Detection (UFD)
Data Center Features
  • L2 Data Center Bridging
  • CEE v1.01 DCB for PFC/ETS
SDN
  • Open Flow 1.x
Security Features
  • Switch access password protection
  • RADIUS and TACACS+ Authentication
  • Access Control Lists
  • SSH, SSL Encryption
System Management
  • Industry Standard CLI
  • Command completion
  • Context-sensitive help
  • SNMP v1/v2/v3
  • SSH
  • TFTP Client
  • Syslog
  • DHCP (Client)
  • Web-based management interface - HTTP/HTTPS
  • NTP
  • XML-RPC
Multicast
  • IGMP Snooping
Weight
  • 3.2lbs/1.5kg
Dimensions (W x D x H)
  • 267mm x 159mm x 36mm (10.5" x 6.25" x 1.4")
Download

Switch Modules:
| SBM-25G-100 | MBM-XEM-002 | MBM-GEM-004 | MBM-XEM-001 | MBM-GEM-001 |

HPC Modules with 8U SuperBlade

InfiniBand Switch Module

The InfiniBand switch is based on point-to-point bi-directional serial link systems. It provides high-speed interconnectivity among the blade modules and to external InfiiniBand peripherals and are especially useful in supporting clustered High-Performance-Computing. The SBM-IBS-E3616 InfiniBand switch supports up to twenty internal and 16 external connections (100G).

Omni-path Architecture Switch Module

Supermicro SBM-OPA-C4020 supports the 100Gbps Intel® Omni-Path Architecture (OPA) providing a unique HPC cluster solution offering excellent bandwidth, latency and message rate that is highly scalable and easily serviceable.

SBM-OPA-C4020 supporting Omni-Path Architecture leverages the Intel Scalable System Framework (SSF) to address evolving demands across high performance data analytics, machine learning, visualization, traditional modeling and simulation workloads. Designed specifically for HPC, the SBM-OPA-C4020 products offer 9.6 Tb/s total fabric bandwidth. High scalability with the capability of 27,648 nodes in 2-tier configuration. Supermicro SBM-OPA-C4020 is designed to overcome the scaling challenges of large-sized clusters. The enhancements include:

High Message Rate Throughput. The SSH-C48Q products are designed to support high message rate traffic from each node through the fabric. That means the fabric can support the high bandwidth as well as high message rate throughput associated with the ever-increasing processing power and core counts of Intel® Processor.

100Gb EDR InfiniBand Switch
SBM-IBS-E3616
100Gb EDR InfiniBand Switch
Switch Chip
  • Mellanox Switch-IB
Internal Ports
  • Twenty EDR ports at 100Gbps
External Uplink Ports
  • Sixteen EDR ports with QSFP28 connectors
Bandwidth
  • 7.62Tbps total switch bandwidth (36-Port)
100Gb Omni-path Switch
SBM-OPA-C4020
100Gb Omni-path Switch
Switch Chip
  • Intel Omni-path chipset
Internal Ports
  • Twenty ports at 100Gbps
External Uplink Ports
  • Twenty four 100Gbs ports with QSFP28 connectors
Bandwidth
  • 9.6 Tbps total switch bandwidth (44-Port)

 

Mezzanine Cards

For any blade to access the InfiniBand, Omni-path, or 25G Ethernet module, it must have a respective Mezzanine card installed on its mainboard. The AOC-IBH-X4ES and AOC-OPH-WFR support EDR and Omni-path switches, respectively. The AOC-B25G-X4D and AOC-B25G-6X4D support 8U and 6U SuperBlade 25G Ethernet switches, respectively.

Dual-Port 25G Ethernet card
AOC-B25G-X4D (Mezzanine 25G)
 
Chipset
  • Mellanox ConnectX-4
Ports
  • Two 25G/10G ports
Power Consumption
  • 12.5W typical/ 14.6W max
Dual-Port 25G Ethernet card
AOC-B25G-6X4D (Mezzanine 25G)
 
Chipset
  • Mellanox ConnectX-4
Ports
  • Two 25G/10G ports
Power Consumption
  • 12.5W typical/ 14.6W max
100Gb Omni-path Switch
AOC-IBH-X4ES (Mezzanine EDR HCA)
 
Chipset
  • Mellanox ConnectX-4
Ports
  • One EDR 100-Gbps port
Power Consumption
  • 12.5W typical/ 14.6W max
100Gb Omni-path Switch
AOC-OPH-WFR (Mezzanine OPA)
 
Chipset
  • Intel Omni-path Wolfriver
Ports
  • One 100-Gbps port
Power Consumption
  • 13.12W typical/ 16.65W max
 
Optional Parts List ( Ethernet Cabling Guide )
  Part Number Description
SFP+ Cable CBL-SFP+AOC-1M-1 ETHERNET, SFP+, 10GbE, FIBER, ACTIVE, PULL, 1M
SFP+ Cable CBL-SFP+AOC-3M-1 ETHERNET, SFP+, 10GbE, FIBER, ACTIVE, PULL, 3M
SFP+ Cable CBL-SFP+AOC-3M-1-ORG ETHERNET, SFP+, 10GbE, FIBER, ACTIVE, PULL, 3M, Orange
SFP+ Cable CBL-SFP+AOC-5M-1 ETHERNET, SFP+, 10GbE, FIBER, ACTIVE, PULL, 5M
SFP+ Cable CBL-SFP+AOC-5M-1-ORG ETHERNET, SFP+, 10GbE, FIBER, ACTIVE, PULL, 5M, Orange
SFP+ Cable CBL-SFP+AOC-7M-1-ORG ETHERNET, SFP+, 10GbE, FIBER, ACTIVE, PULL, 7M, Orange
SFP+ Cable CBL-SFP+AOC-10M ETHERNET, SFP+, 10GbE, FIBER, ACTIVE, PULL, 10M
QSFP Cable CBL-NTWK-0417-01 ETHERNET, QSFP, 40GbE, PASSIVE, 1M
QSFP Cable CBL-NTWK-0325-02 ETHERNET, QSFP, 40GbE, PASSIVE, 2M
QSFP Cable CBL-NTWK-0446-01 ETHERNET, QSFP, 40GbE, PASSIVE, 3M
QSFP Cable CBL-NTWK-0422-01 ETHERNET, QSFP, 40GbE, PASSIVE, 5M
QSFP Cable CBL-QSFP+AOC-1M ETHERNET, QSFP, QDR, 40GbE, FIBER, ACTIVE, PULL, 1M
QSFP Cable CBL-QSFP+AOC-5M-1 ETHERNET, QSFP, QDR, 40GbE, FIBER, ACTIVE, PULL, 5M
QSFP Cable CBL-QSFP+AOC-10M-1 ETHERNET, QSFP, QDR, 40GbE, FIBER, ACTIVE, PULL, 10M
QSFP Cable CBL-NTWK-0719 ETHERNET, 40GbE/QSFP+ to 4x 10GbE/SFP+, PASSIVE, 1M, Mellanox
QSFP Cable CBL-NTWK-0720 ETHERNET, 40GbE/QSFP+ to 4x 10GbE/SFP+, PASSIVE, 3M, Mellanox
QSFP Cable CBL-NTWK-0721 ETHERNET, 40GbE/QSFP+ to 4x 10GbE/SFP+, PASSIVE, 5M, Mellanox
Optional Parts List ( Infiniband )
  Part Number Description
InfiniBand CBL-NTWK-0942-MQ28E10M InfiniBand, EDR, QSFP28, 100GbE, PASSIVE, LSZH, 1M, Mellanox
InfiniBand CBL-NTWK-0942-MQ28E15M InfiniBand, EDR, QSFP28, 100GbE, PASSIVE, LSZH, 1.5M, Mellanox
InfiniBand CBL-NTWK-0942-MQ28E20M InfiniBand, EDR, QSFP28, 100GbE, PASSIVE, LSZH, 2M, Mellanox
InfiniBand CBL-NTWK-0942-MQ28E30M InfiniBand, EDR, QSFP28, 100GbE, PASSIVE, LSZH, 3M, Mellanox
Optional Parts List ( Omni-path )
  Part Number Description
Omni-Path CBL-NTWK-0892-OPC05 Intel Omni-Path Passive Copper Cable QSFP28, 0.5M
Omni-Path CBL-NTWK-0892-OPC10 Intel Omni-Path Passive Copper Cable QSFP28, 1M
Omni-Path CBL-NTWK-0892-OPC15 Intel Omni-Path Passive Copper Cable QSFP28, 1.5M
Omni-Path CBL-NTWK-0892-OPC20 Intel Omni-Path Passive Copper Cable QSFP28, 2M
Omni-Path CBL-NTWK-0892-OPC30 Intel Omni-Path Passive Copper Cable QSFP28, 3M
Omni-Path CBL-NTWK-0892-OPF30L Intel Omni-Path Active Fiber Cable QSFP28, 3M
Omni-Path CBL-NTWK-0892-OPF50L Intel Omni-Path Active Fiber Cable QSFP28, 5M
Omni-Path CBL-NTWK-0892-OPF100L Intel Omni-Path Active Fiber Cable QSFP28, 10M
Omni-Path CBL-NTWK-0892-OPF150L Intel Omni-Path Active Fiber Cable QSFP28, 15M
Omni-Path CBL-NTWK-0892-OPF200L Intel Omni-Path Active Fiber Cable QSFP28, 20M
Omni-Path CBL-NTWK-0892-OPF300L Intel Omni-Path Active Fiber Cable QSFP28, 30M
Omni-Path CBL-NTWK-0892-OPF400L Intel Omni-Path Active Fiber Cable QSFP28, 40M
Omni-Path CBL-NTWK-0892-OPF500L Intel Omni-Path Active Fiber Cable QSFP28, 50M
Omni-Path CBL-NTWK-0892-OPF600L Intel Omni-Path Active Fiber Cable QSFP28, 60M