[YouTube] — We take a look at a state-of-the-art liquid cooled NVIDIA H100 8x GPU server from Supermicro. We show why modern AI servers need liquid cooling. We also show some of the other cool bits from the company's liquid cooling lab including 2U 4-node servers with Intel Xeon and AMD EPYC liquid cooling blocks.
We take a look at Supermicro's custom liquid cooling rack, and specifically what it is doing around liquid cooling distribution for AI and HPC
If you take nothing else from this review, this should be the image that sticks in your mind when thinking about the Supermicro SYS-551A-T. There are class-leading 16 DDR5 DIMM slots, liquid cooling for the 56-core Xeon W CPU, six PCIe Gen5 x16 slots, and four M.2 slots for an onboard storage array.
AS-2125HS-TNR is an AMD based storage-oriented platform that focuses on the compute. Going from Milan to Genoa, we moved onto PCIe Gen5 and DDR5 memory, so we doubled the amount of PCIe bandwidth that we have. We also have 128 lanes between the two CPU sockets. The fourth high speed GMI link between the sockets is much appreciated. The system has a simple but very effective mechanism for routing cooling the CPUs. DDR5 memory; however, is using a bit more power than the last generation of DDR4.
With the Intel Xeon Max testing at Phoronix that's been ongoing so far for the past month on Phoronix has all been done within the Supermicro Hyper SuperServer SYS-221H-TNR rackmount server.
Today we are going to look at a great AMD EPYC server. The Supermicro AS-2015CS-TNR is a single-socket AMD EPYC 9004 “Genoa” server, but the configuration we had was one we had for the first time.
Today is a very fun and interesting round of benchmarking... Recently Supermicro sent over their Hyper SuperServer SYS-221H-TNR and Intel supplied the Xeon Max 9468 and Xeon Max 9480 for finally being able to benchmark Xeon Max processors, the Sapphire Rapids parts featuring 64GB of HBM2e memory.
Supermicro has unveiled a new server solution aimed at meeting the high-performance and scalability needs of today’s IT and data center owners.
Many of our readers are already familiar with the Supermicro MicroCloud. The MicroCloud is popular in web and dedicated hosting markets where sharing the chassis, power, and cooling are desired while still maintaining physical nodes.
Supermicro showed off a large number of systems at ISC 2023. One of them particularly will be impactful. Supermicro had a liquid-cooled 8x NVIDIA H100 Delta-Next platform at the show and it was different than we expected.
