Drilldown: Platform

ASRock Rack ROMED8-2T · ASUS P9X79 WS · ASUS Pro WS WRX80E-SAGE SE WIFI · ASUS Pro WS WRX90E-SAGE SE · ASUS X99-E WS · Dell OptiPlex 7040m · Dell PowerEdge R720 · Dell PowerEdge R730 · Dell PowerEdge R740 · Dell Precision T5810 · Gigabyte G292-Z20 · Gigabyte G481-HA0 · Gigabyte MZ31-AR0 · Gigabyte MZ32-AR0 · Huananzhi H12D-8D · Huananzhi X99-F8 · Hyve Edge Metal G10 · Minisforum MS-01 · Supermicro H12DSG-O-CPU · Supermicro SYS-4028GR-TRT2 · Supermicro X11SPA-TF · Tyan S8030GM2NE · Other · None

ASRock Rack ROMED8-2T (also ROMED8-2T/BCM) (1) · ASUS P9X79 WS (1) · ASUS Pro WS WRX80E-SAGE SE WIFI ("ASUS WRX80E") (1) · ASUS Pro WS WRX90E-SAGE SE ("ASUS WRX90") (1) · ASUS X99-E WS (USB 3.1) (1) · Dell OptiPlex 7040m (micro PC) with an M.2 to OcuLink adapter and an external GPU frame (1) · Dell PowerEdge R720 (2U, 12th generation) (1) · Dell PowerEdge R730 (2U; the Dell Precision Rack 7910 is the same server with a different label) (1) · Dell PowerEdge R740 (14th generation) (1) · Dell Precision T5810 (workstation) (1) · Gigabyte G292-Z20 (2U, 8 GPU) (1) · Gigabyte G481-HA0 (4U GPU server) (1) · Gigabyte MZ31-AR0 (1) · Gigabyte MZ32-AR0 (rev 1.0 / 1.1) (1) · Huananzhi H12D-8D (1) · Huananzhi X99-F8 (also X99-T8 / TD8) (1) · Hyve Edge Metal G10 AMD EPYC diskless server (Tyan Tomcat board) (1) · Minisforum MS-01 (mini PC) with a PLX 88096 switch board (1) · Supermicro H12DSG-O-CPU (Supermicro AS-4124GS-TNR 4U GPU server) (1) · Supermicro SYS-4028GR-TRT2 (X10DRG-O-PCIE class board; also 4028GR-TRT) (1) · Supermicro X11SPA-TF (E-ATX, LGA3647, rev 1.0) (1) · Tyan S8030GM2NE (1)

AMD EPYC (1) · AMD EPYC 7R13 (48 cores) (1) · AMD Threadripper Pro (sWRX8) (1) · AMD Threadripper Pro 7000 (sTR5) (1) · Dual AMD EPYC Rome (1) · Dual Intel Xeon E5 v1/v2 (LGA2011, DDR3) (1) · Dual Intel Xeon E5 v3/v4 (1) · Dual Intel Xeon E5 v3/v4 (E5-2673 v4 used), DDR4 up to 2400 MHz (1) · Dual Intel Xeon Gold 6152 (1) · Dual Intel Xeon Scalable (1) · Intel (MS-01 mobile CPU, model not given) (1) · Intel Core i5 ("5 core" as posted) (1) · Intel LGA2011 (X79) (1) · Intel Xeon E5 v3/v4 (LGA2011-3), for example E5-2696 v3 (1) · Intel Xeon E5 v3/v4 (single socket) (1) · Intel Xeon E5-2695 v4 (1) · Intel Xeon Scalable or Xeon W-3200 (1) · Single-socket AMD EPYC (1) · Single-socket AMD EPYC (SP3) (1) · Single-socket AMD EPYC (SP3), for example EPYC 7543 (1) · Single-socket AMD EPYC 7002/7003 (7K62 suggested) (1) · Single-socket AMD EPYC Rome or Milan (7K62 suggested) (1)

None (21) · (the BIOS mod targets 1317) (1)

None (16) · (OcuLink from M.2) (1) · 10 GB cards at Gen3 on this Gen3 board (after the 10 GB Gen3 unlock) (1) · All cards at x16 (generation not stated) (1) · Gen2 x16 on all 8 cards (1) · one slot never trains x16, another later dropped to x8 (1) · two cards limited to x8 by slot wiring (1)

None (17) · 64 GB BAR1 on all 8 cards (firmware sizes 64 MB, the patched driver resizes to 65536 MB) (1) · BAR1 cannot be assigned ("no space"); stays 64 MB (1) · BAR1 cannot be assigned (same "no space" problem as the WRX80E) (1) · BAR1 stuck at 64 MB on 4 cards; 2 of 4 reached 64 GB after MMIOH changes; MMIOH size prevents all 4 (1) · Unlock works after the MMIOH change; BAR1 size not reported (1)

None (14) · All 10 GPU slots on CPU1 behind two PEX9797 (PCIe 3.0) switches, five slots each: in-switch P2P expected good, cross-switch traffic goes through the CPU (1) · Each GPU pair sits on its own PCIe switch: good P2P within a pair, slower between pairs (1) · Fixed by the curiouspixel P2P patch in the Morrowmake cmpunlocker fork (works without the 64 GB BAR1) (1) · Fixed by the curiouspixel P2P patch in the Morrowmake cmpunlocker fork, without the 64 GB BAR1 (1) · n/a (one card) (1) · replacedriver47: no transfers with the Morrowmake P2P fork, even with 2 cards at 64 GB BAR1; Con3po: mailbox P2P with 8 cards on MS-01s (1) · Working on all 8 cards, across both sockets: <code>'"`UNIQ--nowiki-000000FE-QINU`"'</code> 504/504 with the Morrowmake P2P build; <code>'"`UNIQ--nowiki-000000FF-QINU`"'</code> = 1 for every pair (1) · Works (Miséricorde) (1)

None (15) · Linux (distribution not given) (1) · Morrowmake cmpunlocker P2P fork (1) · Morrowmake/cmpunlocker (2) · Proxmox (version not given) (1) · Ubuntu (version not given) (1) · Ubuntu 24.04, kernel 6.8.0, nvidia-open 615.71.09, Morrowmake/cmpunlocker <code>'"`UNIQ--nowiki-00000100-QINU`"'</code> <code>'"`UNIQ--nowiki-00000101-QINU`"'</code> (1)

Bare metal (21) · VM (1)

None (17) · 10 GB (2) · 8 GB (3)

None (22)

Proven (2) · Reported (19) · Theory (1)

None (1) · 1a2b3c0967 (1) · chonsworth (1) · darkmaniac7 (1) · djpandaman (2) · fdelfini (1) · finishtilt14 (1) · fnerdman (1) · ghostinthedatacenter_87281 (1) · globalapathy (1) · kellertreppe123 (1) · markshowa (1) · matstatman (1) · nathang6866 (1) · port00 (1) · redpandamining (1) · replacedriver47 (1) · trustinter (1) · wakeupmbrc1 (2) · zorg33 (1)

https://discord.com/channels/1518634379604136178/1518692084729511967/1556145943949082696 (1) · https://discord.com/channels/1518634379604136178/1518692084729511967/1556146477019963423 (1) · https://discord.com/channels/1518634379604136178/1518692084729511967/1557377602212204607 (1) · https://discord.com/channels/1518634379604136178/1518692084729511967/1557381633521492011 (1) · https://discord.com/channels/1518634379604136178/1518692084729511967/1557500766497804368 (1) · https://discord.com/channels/1518634379604136178/1518692084729511967/1557512606510489693 (1) · https://discord.com/channels/1518634379604136178/1518692084729511967/1558043174000267285 (1) · https://discord.com/channels/1518634379604136178/1518692084729511967/1561375163210141767 (1) · https://discord.com/channels/1518634379604136178/1518692084729511967/1561810276351741975 (1) · https://discord.com/channels/1518634379604136178/1518692084729511967/1563727993896177735 (1) · https://discord.com/channels/1518634379604136178/1518695289278566450/1558565136980254791 (1) · https://discord.com/channels/1518634379604136178/1528826330454429706/1560411782588137553 (1) · https://discord.com/channels/1518634379604136178/1528826330454429706/1560652393497235579 (1) · https://discord.com/channels/1518634379604136178/1534370835220004885/1557989512335073291 (1) · https://discord.com/channels/1518634379604136178/1534370835220004885/1557993709369434115 (1) · https://discord.com/channels/1518634379604136178/1534370835220004885/1558775876743856149 (1) · https://discord.com/channels/1518634379604136178/1534370835220004885/1559213748290592780 (1) · https://discord.com/channels/1518634379604136178/1534370835220004885/1561798498905755670 (1) · https://discord.com/channels/1518634379604136178/1534370835220004885/1563122104906547242 (1) · https://discord.com/channels/1518634379604136178/1534370835220004885/1563212974896713801 (1) · https://discord.com/channels/1518634379604136178/1534370835220004885/1564244395887435847 (1) · lab notes (@darkmaniac7) (1)