ImportBot: Import: cmp170hx-testsuite, @boz._., @djpandaman; repos dev-boz/cmp170hx-testsuite

2026-10-30T08:38:17Z

Import: cmp170hx-testsuite, @boz._., @djpandaman; repos dev-boz/cmp170hx-testsuite

← Older revision		Revision as of 08:38, 30 October 2026
Line 1:		Line 1:
			{{DISPLAYTITLE:cmp170hx-testsuite}}
	{{Status\|Reported}} {{Cards\|both}}		{{Status\|Reported}} {{Cards\|both}}

ImportBot: Import: cmp170hx-testsuite, @boz._., @djpandaman; repos dev-boz/cmp170hx-testsuite

2026-10-30T08:03:59Z

Import: cmp170hx-testsuite, @boz._., @djpandaman; repos dev-boz/cmp170hx-testsuite

New page

{{Status|Reported}} {{Cards|both}}

'''cmp170hx-testsuite''' is an acceptance test suite for unlocked CMP 170HX cards (64 GB on the 8 GB card <code><nowiki>10de:20c2</nowiki></code>, 40 GB on the 10 GB card <code><nowiki>10de:2082</nowiki></code>). It was written to catch HBM faults that pass light tests, most memtest_vulkan runs and every compute test. Each command says what it does, shows the exact command and the pass rule, shows live output, ends with PASS or FAIL, and saves raw logs per card serial and date, so a session can be filmed or shared with a seller. {{Source|handle=boz._.|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558098091574562848|repo=https://github.com/dev-boz/cmp170hx-testsuite}}.

Author: @boz._. (GitHub dev-boz), MIT. "i got claude to build a test suite for new cards"; he invites people to add to it or fork it. {{Source|handle=boz._.|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558098091574562848}} Repository: https://github.com/dev-boz/cmp170hx-testsuite

== Commands ==
{| class="wikitable"
! Command !! Time !! Checks !! Pass rule
|-
| <code><nowiki>cmp-identity</nowiki></code> || instant || serial, UUID, VBIOS, memory size, PCIe link, kernel GPU errors || CMP 170HX with full unlocked memory (65536 or 40960 MiB), 0 Xid
|-
| <code><nowiki>cmp-hbm-test [min]</nowiki></code> || 10 min (5 is enough) || all free VRAM, walking-bit pattern alternating with full-bandwidth random data, every word verified || 0 errors
|-
| <code><nowiki>cmp-tensor-test [s]</nowiki></code> || 5 min || INT8 and FP16 tensor-core matmuls on every SM against an exact reference || 0 errors, every SM used
|-
| <code><nowiki>cmp-sm-test</nowiki></code> || under 1 min || fixed workload on every SM, bit-compared with a known-good baseline || bit-identical
|-
| <code><nowiki>cmp-ai-test</nowiki></code> || 2 to 4 min || real llama.cpp inference plus every weight read back from VRAM || expected answer, no NaN, 0 bytes differ
|-
| <code><nowiki>cmp-kernel-check</nowiki></code> || instant || NVIDIA Xid reports since the first test today || 0 Xid
|-
| <code><nowiki>cmp-summary</nowiki></code> || instant || table of today's results for this card ||
|-
| <code><nowiki>cmp-hbm-map [min]</nowiki></code> || 5 min || diagnostic: maps HBM errors to fixed 2 MiB physical blocks ||
|-
| <code><nowiki>cmp-telemetry</nowiki></code> || live || temperatures, power, load, VRAM, clocks, blower rpm, Xid count ||
|}
{{Source|handle=boz._.|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558098091574562848|repo=https://github.com/dev-boz/cmp170hx-testsuite}}.

== Install ==
Needs Linux with a driver that runs the card unlocked, the CUDA toolkit (<code><nowiki>nvcc</nowiki></code>, sm_80), and read access to the kernel log. <code><nowiki>cmp-ai-test</nowiki></code> also needs llama.cpp built with CUDA and a GGUF that fits on one card. Developed on driver 610.57.04 (open modules with an unlock patch set), CUDA 12.8, Linux 7.0, an X399 Threadripper board. {{Source|handle=boz._.|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558098091574562848|repo=https://github.com/dev-boz/cmp170hx-testsuite}}.
<syntaxhighlight lang="bash">
git clone https://github.com/dev-boz/cmp170hx-testsuite && cd cmp170hx-testsuite
LLAMA_DIR=~/llama.cpp ./install.sh # builds bin/, links cmp-* into ~/.local/bin; omit LLAMA_DIR to skip the AI test
cp config.example.sh config.sh # optional: model path, blower tach mapping, output folders
./install.sh remove # removes the links
</syntaxhighlight>

== Usage ==
One card at a time; cap the power (<code><nowiki>sudo nvidia-smi -i <index> -pl 180</nowiki></code>, resets every boot) and run the blower at full speed. GPU tests run under <code><nowiki>scripts/guard.sh</nowiki></code>, which stops them at 72 C core or 85 C HBM (<code><nowiki>GPU_LIMIT</nowiki></code>, <code><nowiki>MEM_LIMIT</nowiki></code>). Suggested order, about 40 minutes: <code><nowiki>cmp-identity</nowiki></code>; memtest_vulkan for 5 minutes right after a cold boot; <code><nowiki>gpu_burn -tc -m 95% 300</nowiki></code>; <code><nowiki>cmp-hbm-test 5</nowiki></code>, <code><nowiki>cmp-tensor-test</nowiki></code>, <code><nowiki>cmp-sm-test</nowiki></code>, <code><nowiki>cmp-ai-test</nowiki></code>; <code><nowiki>cmp-kernel-check</nowiki></code>, <code><nowiki>cmp-summary</nowiki></code>. <code><nowiki>docs/filming.md</nowiki></code> has a run sheet for filming it in one take. {{Source|handle=boz._.|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558098091574562848|repo=https://github.com/dev-boz/cmp170hx-testsuite}}. The full sequence with the other tools is on [[Testing and burn-in]].

== The bad card it was built on ==
{{Status|Warning}} Unlocked to 64 GB, 180 W, normal temperatures, faulty in every slot and on every cable: whole 128-byte blocks read back as zeros or unrelated data from the first second of each run; gpu-burn reported 0.6 to 1.9 billion errors; memtest_vulkan failed only right after a cold boot; compute was clean. Under load its firmware crashed (Xid 119, Xid 1, Xid 154 or Xid 62) and only a 30-second power-off recovered it. <code><nowiki>cmp-hbm-map</nowiki></code> showed 24 percent of VRAM failing within 58 seconds, with errors following launch timing rather than location: a load-transient fault that block quarantine cannot fix. {{Source|handle=boz._.|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558098091574562848|repo=https://github.com/dev-boz/cmp170hx-testsuite}}.

== Caveats ==
* One commit, AI-written by the author's own account. As of 2026-10-12 nobody else had reported running it. When @djpandaman asked for a benchmark suite, @boz._. pointed here and noted it is tests, not benchmarks. {{Source|handle=djpandaman|date=2026-10-12|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1559332463216427009}}<br />{{Source|handle=boz._.|date=2026-10-12|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1559335709004013591}}
* It assumes one CMP in the machine, or <code><nowiki>SERIAL=...</nowiki></code> to pick one. memtest_vulkan and gpu-burn are separate projects, not included. {{Source|handle=boz._.|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558098091574562848|repo=https://github.com/dev-boz/cmp170hx-testsuite}}.
* If <code><nowiki>cmp-sm-test</nowiki></code> fails on every card including good ones, a different compiler changed the FP32 results; record your own baseline on a good card (<code><nowiki>bin/sm-verify record <file></nowiki></code>, then set <code><nowiki>CMP_SM_BASELINE</nowiki></code>). {{Source|handle=boz._.|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558098091574562848|repo=https://github.com/dev-boz/cmp170hx-testsuite}}.

== See also ==
* [[Testing and burn-in]]
* [[Acceptance checklist]]
* [[Tools]]

{{ImportFooter}}
[[Category:Tools]]
[[Category:8 GB]]
[[Category:10 GB]]

Cmp170hx-testsuite - Revision history

ImportBot: Import: cmp170hx-testsuite, @boz._., @djpandaman; repos dev-boz/cmp170hx-testsuite

ImportBot: Import: cmp170hx-testsuite, @boz._., @djpandaman; repos dev-boz/cmp170hx-testsuite