For GPU system, we usually provide diagnostic/FW-Checking tool(s) from both NVIDIA and from Supermicro.
EX:
Fieldiag tool and SUM utility.
When GPU package drivers are installed in OS, basic GPU checks are available through NVIDIA commands, like nvidia-smi, nvidia-bug-report, and others; like lspci.