2. Install the version of RedHat or SuSELinux that is supported by OFED to the server first. (Note: Only the standard Kernel is supported by Mellanox. The Xen kernel is not supported.) For more information, please check out the MLNX OFED Installation Guide in Mellanox website.
3. In Linux Terminal Console, mount the OFED ISO downloaded in step 1.
Host1#> mount –o ro,loop MLNX_OFED_LINUX--.iso /mnt
4. Install OFED:
Host1#> mnt/mlnxofedinstall
5. Reboot the Linux server.
6. Copy the correct version of Infiniband firmware to the local hard disk in Linux.
7. In Linux, you can use command “ifconfig –a” to check if you can see the “ib0” port.
8. Note that one of the server or device must run the Subnet Manager to support the IBoIP. A utility called “opensm” is included.
9. After you configure the IP for your IB port, you should be able to ping each others.
--Below is for checking the Infiniband controller info & upgrading the firmware only--
10. Start MST:
Host1#> mst start (Note: If it failed, try “mst restart”.)
11. Issue the following command to determine the Infiniband device name:
Host1#> ls /dev/mst
The “mt264xx_pciconf0” is the Infiniband device name, and the “mt254xx_pciconf0” is the 10GbE device name. Only one of the above devices will show depending on which firmware (Infiniband or 10GbE) is installed.
12. Identify the Mellanox chip type & version:
Host#> ibstat
CA 'mlx4_0'
CA type: MT26428
Number of ports: 1
Firmware version: 2.7.2
Hardware version: B0
Node GUID: 0x003048ffffce0a80
System image GUID: 0x003048ffffce0a83
Port 1:
….
Note:
MT26418 = DDR chip (X8DTT-HIBX)
MT26428 = QDR chip (X8DTT-HIBQ / AOC-UIBQ-M2)
Hardware version tells whether it’s the A0 (ConnectX) or the B0 (Connect-X) chip.
Please use:
(1) the firmware “X8DTT-IBX_20100122_ConnectX_270_10GE_1MB_test2.bin” for the A0 chip
(2) the firmware “X8DTT-IBX_2010607_ConnectX-2_272_10GE_Test2.bin” for the B0 chip.
14. After the utility confirms completed, reboot the system again to load the new driver for the new firmware.
15. In Linux Terminal Console, issue the following command to make sure the firmware is functioning.
Host1#> ls /dev/mst
Host1#> flint –d /dev/mst/mt2xxxx_pciconf0 q
16. The motherboard is ready for new 10GbE firmware.