File:Cmpbench.py

Cmpbench.py (file size: 60 KB, MIME type: application/x-env)

Warning: This file type may contain malicious code. By executing it, your system may be compromised.

cmpbench.py runs the Benchmark protocol against an OpenAI-compatible inference server (vLLM, SGLang, llama.cpp server, TabbyAPI) and prints the numbers as lines for a Recipe infobox and a Confirmation. Python 3.9 or newer, standard library only, one file.

Download: Cmpbench.py (59.5 KB)
Version: 1.0
Upstream source: Benchmark protocol on cmp.wiki (written for this wiki; no other upstream)
sha256: 52b88304593b3af57dd516f2e458832a21f4f801ba3adee58d2e33724e686adc(matches the hash published upstream)
Uploaded by: @ImportBot on 2026-11-04 00:02 UTC
Protocol 1.0. Settings, what to report and how to fill the infobox: Benchmark protocol.

Usage

curl -L -o cmpbench.py https://cmp.wiki/wiki/Special:Redirect/file/Cmpbench.py
python3 cmpbench.py --base-url http://localhost:8000/v1 --model MODEL --spec-decode "MTP 3"
python3 cmpbench.py --help

It sends requests only to --base-url and reads nvidia-smi and lspci -nn on the machine it runs on. It never reads GPU serial numbers or UUIDs.

License

Source: @darkmaniac7, 2026-11-03 (lab notes)

File history

Click on a date/time to view the file as it appeared at that time.

	Date/Time	Dimensions	User	Comment
current	00:02, 4 November 2026	(60 KB)	ImportBot (talk \| contribs)	cmpbench.py 1.0, the Benchmark protocol 1.0 script (MIT), lab notes

You cannot overwrite this file.

File usage

The following 2 pages use this file: