<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://cmp.wiki/w/index.php?action=history&amp;feed=atom&amp;title=Thermal_limits</id>
	<title>Thermal limits - Revision history</title>
	<link rel="self" type="application/atom+xml" href="https://cmp.wiki/w/index.php?action=history&amp;feed=atom&amp;title=Thermal_limits"/>
	<link rel="alternate" type="text/html" href="https://cmp.wiki/w/index.php?title=Thermal_limits&amp;action=history"/>
	<updated>2026-10-31T01:35:06Z</updated>
	<subtitle>Revision history for this page on the wiki</subtitle>
	<generator>MediaWiki 1.43.11</generator>
	<entry>
		<id>https://cmp.wiki/w/index.php?title=Thermal_limits&amp;diff=477&amp;oldid=prev</id>
		<title>ImportBot: Core and HBM temperature thresholds, throttling and drop-off behaviour, what temperatures people run at, how to read the sensors; from the cmpunlocker Discord (2026-10-04 to 10-27), cachenetics/170tune, PixelML/club-170hx, amoghmunikote/170th-Street, matstatman/hbmmon and Ivan&#039;s lab notes; gap-fill from #general 2026-10-23 (400 W spike at a 250 W limit), @djpandaman, @xeax</title>
		<link rel="alternate" type="text/html" href="https://cmp.wiki/w/index.php?title=Thermal_limits&amp;diff=477&amp;oldid=prev"/>
		<updated>2026-10-30T10:02:38Z</updated>

		<summary type="html">&lt;p&gt;Core and HBM temperature thresholds, throttling and drop-off behaviour, what temperatures people run at, how to read the sensors; from the cmpunlocker Discord (2026-10-04 to 10-27), cachenetics/170tune, PixelML/club-170hx, amoghmunikote/170th-Street, matstatman/hbmmon and Ivan&amp;#039;s lab notes; gap-fill from #general 2026-10-23 (400 W spike at a 250 W limit), @djpandaman, @xeax&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 10:02, 30 October 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l40&quot;&gt;Line 40:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 40:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;== Throttling behaviour ==&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;== Throttling behaviour ==&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* When the cap or the temperature limit bites, the core clock drops and with it memory bandwidth and tokens per second. On a 10 GB card with all SMs unlocked, the power cap tanked memory bandwidth even with the clock locked. {{Source|handle=djpandaman|date=2026-10-12|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1559236914391949484}} See [[Undervolting and power limits]].&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* When the cap or the temperature limit bites, the core clock drops and with it memory bandwidth and tokens per second. On a 10 GB card with all SMs unlocked, the power cap tanked memory bandwidth even with the clock locked. {{Source|handle=djpandaman|date=2026-10-12|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1559236914391949484}} See [[Undervolting and power limits]].&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-side-deleted&quot;&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;* {{Status|Warning}} &#039;&#039;&#039;A 250 W cap did not bound a fully SM-unlocked 10 GB card.&#039;&#039;&#039; @djpandaman&#039;s card at 122 SMs briefly reported about 400 W of board power during benchmarks with the limit at 250 W (he was unsure whether the reading was measured or calculated), and all of it ends up in the same heatsink and VRM. @xeax worries the VRM MOSFETs get overloaded and doubts he could cool that load. On such a card, watch core and HBM temperatures under real load instead of trusting the cap, and undervolt (see [[Undervolting and power limits#10 GB cards]] and [[Power supplies and cabling#PSU sizing]]). {{Source|handle=xeax|date=2026-10-23|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1563222111592521881}}&amp;lt;br /&amp;gt;{{Source|handle=djpandaman|date=2026-10-23|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1563222404627431497}}&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* Prefill is where cards run hottest: @c133&amp;#039;s cards spike over their cap during long prefills {{Source|handle=c133|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558163141723037798}}; PixelML&amp;#039;s worst-airflow card reached 80 to 85 C core on long-context prefill at 180 W, which is why they lowered the cap {{Source|repo=https://github.com/PixelML/club-170hx}}.&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* Prefill is where cards run hottest: @c133&amp;#039;s cards spike over their cap during long prefills {{Source|handle=c133|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558163141723037798}}; PixelML&amp;#039;s worst-airflow card reached 80 to 85 C core on long-context prefill at 180 W, which is why they lowered the cap {{Source|repo=https://github.com/PixelML/club-170hx}}.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* Check whether the card is in hardware power-brake slowdown: &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi -q | grep -A1 &amp;#039;HW Power Brake Slowdown&amp;#039;&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt;. {{Source|repo=https://github.com/PixelML/club-170hx}}&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* Check whether the card is in hardware power-brake slowdown: &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi -q | grep -A1 &amp;#039;HW Power Brake Slowdown&amp;#039;&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt;. {{Source|repo=https://github.com/PixelML/club-170hx}}&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l85&quot;&gt;Line 85:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 86:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi -q -d TEMPERATURE&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt; {{Source|handle=xeax|date=2026-10-15|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1560253301985906692}}, or for logging &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi --query-gpu=index,temperature.gpu,temperature.memory,power.draw --format=csv&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt; {{Source|repo=https://github.com/PixelML/club-170hx}}. Watch &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;temperature.memory&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt;: HBM is usually the warmest sensor under load. {{Source|repo=https://github.com/cachenetics/170tune}}&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi -q -d TEMPERATURE&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt; {{Source|handle=xeax|date=2026-10-15|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1560253301985906692}}, or for logging &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi --query-gpu=index,temperature.gpu,temperature.memory,power.draw --format=csv&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt; {{Source|repo=https://github.com/PixelML/club-170hx}}. Watch &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;temperature.memory&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt;: HBM is usually the warmest sensor under load. {{Source|repo=https://github.com/cachenetics/170tune}}&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* The card has about 10 temperature sensors, including one per HBM stack. {{Source|handle=matstatman|date=2026-10-05|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1556770474695069718}} [https://github.com/matstatman/hbmmon matstatman/hbmmon] shows per-stack temperature, but it writes to the HBM debug interface by default and needs a custom driver; use its read-only mode on a stock driver. {{Source|handle=matstatman|date=2026-10-05|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1556758870565593288|repo=https://github.com/matstatman/hbmmon|note=no license file}}&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* The card has about 10 temperature sensors, including one per HBM stack. {{Source|handle=matstatman|date=2026-10-05|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1556770474695069718}} [https://github.com/matstatman/hbmmon matstatman/hbmmon] shows per-stack temperature, but it writes to the HBM debug interface by default and needs a custom driver; use its read-only mode on a stock driver. {{Source|handle=matstatman|date=2026-10-05|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1556758870565593288|repo=https://github.com/matstatman/hbmmon|note=no license file}}&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* The 10 GB card&#039;s memory runs a few degrees warmer than the 8 GB card&#039;s (two more half stacks active): 41 C against 37 C at &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the same &lt;/del&gt;33 W idle after a repaste; before the repaste the gap was 13 C, which pointed at the thermal interface. {{Source|handle=ghostinthedatacenter_87281|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559597067352023152}}&amp;lt;br /&amp;gt;{{Source|handle=colo2442|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559599442166812784}}&amp;lt;br /&amp;gt;{{Source|handle=djpandaman|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559649510827757569}}&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* The 10 GB card&#039;s memory runs a few degrees warmer than the 8 GB card&#039;s (two more half stacks active): 41 C against 37 C&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;, both &lt;/ins&gt;at &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;about &lt;/ins&gt;33 W idle&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;, &lt;/ins&gt;after a repaste; before the repaste the gap was 13 C, which pointed at the thermal interface&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;. The owner used PTM on the 8 GB card and then ran out; what went on the 10 GB card is not stated&lt;/ins&gt;. {{Source|handle=ghostinthedatacenter_87281|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559597067352023152}}&amp;lt;br /&amp;gt;{{Source|handle=colo2442|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559599442166812784}}&amp;lt;br /&amp;gt;{{Source|handle=djpandaman|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559649510827757569&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;}}&amp;lt;br /&amp;gt;{{Source|handle=ghostinthedatacenter_87281|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559651382816936108}}&amp;lt;br /&amp;gt;{{Source|handle=ghostinthedatacenter_87281|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559653025700909117&lt;/ins&gt;}}&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* A server BMC cannot read the temperature of a card on a generic passive riser, so it will not ramp the fans for it. {{Source|handle=fafinet|date=2026-10-21|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1562300430439157850}}&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;* A server BMC cannot read the temperature of a card on a generic passive riser, so it will not ramp the fans for it. {{Source|handle=fafinet|date=2026-10-21|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1562300430439157850}}&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;/tr&gt;

&lt;!-- diff cache key cmp_wiki:diff:1.41:old-381:rev-477:php=table --&gt;
&lt;/table&gt;</summary>
		<author><name>ImportBot</name></author>
	</entry>
	<entry>
		<id>https://cmp.wiki/w/index.php?title=Thermal_limits&amp;diff=381&amp;oldid=prev</id>
		<title>ImportBot: Core and HBM temperature thresholds, throttling and drop-off behaviour, what temperatures people run at, how to read the sensors; from the cmpunlocker Discord (2026-10-04 to 10-27), cachenetics/170tune, PixelML/club-170hx, amoghmunikote/170th-Street, matstatman/hbmmon and Ivan&#039;s lab notes; sources: @zorg33, @c133, @markshowa, @matstatman, @xeax, @rh3dai, @analyticeth, @sojun80, @replacedriver47, @spectakkular, @bigptoughneigh, @mountains1605 (+25 more); GitHub PixelML/club-17</title>
		<link rel="alternate" type="text/html" href="https://cmp.wiki/w/index.php?title=Thermal_limits&amp;diff=381&amp;oldid=prev"/>
		<updated>2026-10-30T08:51:11Z</updated>

		<summary type="html">&lt;p&gt;Core and HBM temperature thresholds, throttling and drop-off behaviour, what temperatures people run at, how to read the sensors; from the cmpunlocker Discord (2026-10-04 to 10-27), cachenetics/170tune, PixelML/club-170hx, amoghmunikote/170th-Street, matstatman/hbmmon and Ivan&amp;#039;s lab notes; sources: @zorg33, @c133, @markshowa, @matstatman, @xeax, @rh3dai, @analyticeth, @sojun80, @replacedriver47, @spectakkular, @bigptoughneigh, @mountains1605 (+25 more); GitHub PixelML/club-17&lt;/p&gt;
&lt;a href=&quot;https://cmp.wiki/w/index.php?title=Thermal_limits&amp;amp;diff=381&amp;amp;oldid=205&quot;&gt;Show changes&lt;/a&gt;</summary>
		<author><name>ImportBot</name></author>
	</entry>
	<entry>
		<id>https://cmp.wiki/w/index.php?title=Thermal_limits&amp;diff=205&amp;oldid=prev</id>
		<title>ImportBot: Core and HBM temperature thresholds, throttling and drop-off behaviour, what temperatures people run at, how to read the sensors; from the cmpunlocker Discord (2026-10-04 to 10-27), cachenetics/170tune, PixelML/club-170hx, amoghmunikote/170th-Street, matstatman/hbmmon and Ivan&#039;s lab notes; sources: @zorg33, @c133, @markshowa, @rh3dai, @matstatman, @xeax, @analyticeth, @sojun80, @replacedriver47, @spectakkular, @bigptoughneigh, @mountains1605 (+24 more); GitHub PixelML/club-17</title>
		<link rel="alternate" type="text/html" href="https://cmp.wiki/w/index.php?title=Thermal_limits&amp;diff=205&amp;oldid=prev"/>
		<updated>2026-10-30T08:05:11Z</updated>

		<summary type="html">&lt;p&gt;Core and HBM temperature thresholds, throttling and drop-off behaviour, what temperatures people run at, how to read the sensors; from the cmpunlocker Discord (2026-10-04 to 10-27), cachenetics/170tune, PixelML/club-170hx, amoghmunikote/170th-Street, matstatman/hbmmon and Ivan&amp;#039;s lab notes; sources: @zorg33, @c133, @markshowa, @rh3dai, @matstatman, @xeax, @analyticeth, @sojun80, @replacedriver47, @spectakkular, @bigptoughneigh, @mountains1605 (+24 more); GitHub PixelML/club-17&lt;/p&gt;
&lt;p&gt;&lt;b&gt;New page&lt;/b&gt;&lt;/p&gt;&lt;div&gt;The CMP 170HX runs hot for its power, and it has two temperatures that matter: the GPU core and the HBM memory. Under&lt;br /&gt;
load the HBM is usually the hotter one, and it is the one that limits memory overclocks and corrupts data first.&lt;br /&gt;
Keep the core under about 80 C and the HBM under about 80 to 85 C for daily use.&lt;br /&gt;
&lt;br /&gt;
== Thresholds ==&lt;br /&gt;
{| class=&amp;quot;wikitable&amp;quot;&lt;br /&gt;
! Sensor !! Temperature !! What happens !! Source&lt;br /&gt;
|-&lt;br /&gt;
| Core || about 76 C || throttling starts, according to a rough cooler model; keep core and HBM under 75 C || {{Status|Theory}} {{Source|handle=zorg33|date=2026-10-20|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1562110412395380767}}&lt;br /&gt;
|-&lt;br /&gt;
| Core || 80 C || PixelML&amp;#039;s stop rule for core temperature || {{Source|handle=c133|date=2026-10-20|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1562161732137386127|repo=https://github.com/PixelML/club-170hx}} (Apache-2.0)&lt;br /&gt;
|-&lt;br /&gt;
| Core || above about 80 C || GA100 leakage rises with temperature and the card runs away thermally || {{Source|handle=markshowa|date=2026-10-18|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1561324784598384784|repo=https://github.com/amoghmunikote/170th-Street}} (no license stated)&lt;br /&gt;
|-&lt;br /&gt;
| Core || 85 C || maximum operating temperature (read from the card) {{Source|handle=rh3dai|date=2026-10-04|link=https://discord.com/channels/1518634379604136178/1518695289278566450/1556287917775655053|repo=https://github.com/cachenetics/170tune}} (MIT); &amp;quot;the cards will throttle at 85&amp;quot; {{Source|handle=matstatman|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558212817121972318}}; &amp;quot;85 degrees is the maximum, so you&amp;#039;re most likely bottlenecked by cooling&amp;quot; {{Source|handle=xeax|date=2026-10-15|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1560252687839133757}} || &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/cachenetics/170tune cachenetics/170tune]&amp;lt;/span&amp;gt;&lt;br /&gt;
|-&lt;br /&gt;
| Core || 95 C || hardware slowdown &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/cachenetics/170tune cachenetics/170tune]&amp;lt;/span&amp;gt;; the card falls off the bus and turns off {{Source|handle=analyticeth|date=2026-10-07|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1557491900934791409}} || see cells&lt;br /&gt;
|-&lt;br /&gt;
| Core || 100 C || one card reached it by accident, cut its power as hard as it could, and still works || {{Source|handle=sojun80|date=2026-10-06|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1556855494008643698}}&lt;br /&gt;
|-&lt;br /&gt;
| HBM || about 75 to 76 C || a memory overclock (NDIV 70 and up) starts to corrupt data; 170tune qualifies NDIV 70 only with HBM at or below about 76 C || &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/cachenetics/170tune cachenetics/170tune]&amp;lt;/span&amp;gt;&lt;br /&gt;
|-&lt;br /&gt;
| HBM || 80 C || &amp;quot;hbm doesn&amp;#039;t have issues until 80c or so&amp;quot; {{Source|handle=replacedriver47|date=2026-10-10|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558399070006157436}}; &amp;quot;anything above 80 is too hot&amp;quot; {{Source|handle=spectakkular|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558215172294840442}} || see cells&lt;br /&gt;
|-&lt;br /&gt;
| HBM || 85 C || PixelML&amp;#039;s stop rule for memory; above 85 C JEDEC halves the refresh interval, so keep stock refresh settings || &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/PixelML/club-170hx PixelML/club-170hx]&amp;lt;/span&amp;gt; {{Source|handle=rh3dai|date=2026-10-04|link=https://discord.com/channels/1518634379604136178/1518695289278566450/1556287917775655053}}, repo [https://github.com/vektorprime/170tune vektorprime/170tune] by vektorprime (fork of cachenetics/170tune) on GitHub (MIT)&lt;br /&gt;
|-&lt;br /&gt;
| HBM || 95 C || maximum operating temperature &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/cachenetics/170tune cachenetics/170tune]&amp;lt;/span&amp;gt;; &amp;quot;a few minutes&amp;quot; at 95 C corrupts data in the WPR {{Source|handle=bigptoughneigh|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558266699218812929}} || see cells&lt;br /&gt;
|}&lt;br /&gt;
&lt;br /&gt;
=== Where people disagree ===&lt;br /&gt;
{{Status|Contested}}&lt;br /&gt;
* How hot is too hot: @mountains1605 called @arabus_74064&amp;#039;s temperatures on Qwen3.8 Next Flash too hot, while @arabus_74064 thought them normal at full load. {{Source|handle=mountains1605|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558199574974304338}}&amp;lt;br /&amp;gt;{{Source|handle=arabus_74064|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558210159942041702}} @replacedriver47: the SMs are not the problem, the HBM is, and it is more prone to heat damage {{Source|handle=replacedriver47|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558217213717254195}}; @rrickk420: &amp;quot;you&amp;#039;re frying your mem&amp;quot; {{Source|handle=rrickk420|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558221699038576726}}; @bigptoughneigh: memory is not always hotter than the core under load {{Source|handle=bigptoughneigh|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558266699218812929}}; @dottoreargus barely reaches 65 C on the same model {{Source|handle=dottoreargus|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558215409625333812}}.&lt;br /&gt;
* @impactic thought the card shuts itself down above 95 C; @prefix10k thought 85 C is already bad. {{Source|handle=prefix10k|date=2026-10-06|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1556853048943452211}}&amp;lt;br /&amp;gt;{{Source|handle=impactic|date=2026-10-06|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1556861368513331264}}&lt;br /&gt;
* The throttle point: 76 C by @zorg33&amp;#039;s model {{Source|handle=zorg33|date=2026-10-20|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1562110412395380767}} against 85 C by @matstatman {{Source|handle=matstatman|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528826330454429706/1558212817121972318}} and the card&amp;#039;s own maximum operating value &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/cachenetics/170tune cachenetics/170tune]&amp;lt;/span&amp;gt;.&lt;br /&gt;
&lt;br /&gt;
== Without airflow the card dies fast ==&lt;br /&gt;
* {{Status|Proven}} A card without a fan reaches 95 C quickly even at its 40 W idle, falls off the bus and turns off. {{Source|handle=analyticeth|date=2026-10-07|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1557491900934791409}}&amp;lt;br /&amp;gt;{{Source|handle=nikhilr1696|date=2026-10-07|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1557492862344630364}} @programmerboi&amp;#039;s passive card stopped showing in &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt; at 85 C while idle {{Source|handle=programmerboi|date=2026-10-16|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1560492431768813611}}, and a new 10 GB card &amp;quot;clocked out in under 5 mins without cooling. way worse than V100&amp;quot; {{Source|handle=programmerboi|date=2026-10-25|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1563704621388529725}}. The heatsink is designed for high-airflow servers and does not work even at idle without it. {{Source|handle=civiloid|date=2026-10-16|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1560561874188374087}}&amp;lt;br /&amp;gt;{{Source|handle=globalapathy|date=2026-10-25|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1563704870073143377}}&lt;br /&gt;
* {{Status|Warning}} A failed fan means a dead card or worse; @nikhilr1696 only runs these cards supervised. {{Source|handle=nikhilr1696|date=2026-10-07|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1557491750145232997}} Use a decent fan, not necessarily a blower. {{Source|handle=cibernox|date=2026-10-07|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1557506106509631579}}&lt;br /&gt;
&lt;br /&gt;
== Throttling behaviour ==&lt;br /&gt;
* When the cap or the temperature limit bites, the core clock drops and with it memory bandwidth and tokens per second. On a 10 GB card with all SMs unlocked, the power cap tanked memory bandwidth even with the clock locked. {{Source|handle=djpandaman|date=2026-10-12|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1559236914391949484}} See [[Undervolting and power limits]].&lt;br /&gt;
* Prefill is where cards run hottest: @c133&amp;#039;s cards spike over their cap during long prefills {{Source|handle=c133|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558163141723037798}}; PixelML&amp;#039;s worst-airflow card reached 80 to 85 C core on long-context prefill at 180 W, which is why they lowered the cap &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/PixelML/club-170hx PixelML/club-170hx]&amp;lt;/span&amp;gt;.&lt;br /&gt;
* Check whether the card is in hardware power-brake slowdown: &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi -q | grep -A1 &amp;#039;HW Power Brake Slowdown&amp;#039;&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt;. &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/PixelML/club-170hx PixelML/club-170hx]&amp;lt;/span&amp;gt;&lt;br /&gt;
* Fixes, in order: improve the air path (see [[Fans and ducts]]), lower the cap ({{Source|handle=xeax|date=2026-10-15|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1560253213268250645}}: &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;sudo nvidia-smi -i 0 -pl 200&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt;), then consider water ([[Water cooling]]). These chips run 400 W on SXM4 boards; better cooling is what unlocks more of them. {{Source|handle=xeax|date=2026-10-15|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1560253818329899039}}&lt;br /&gt;
&lt;br /&gt;
== What temperatures people run at ==&lt;br /&gt;
{| class=&amp;quot;wikitable sortable&amp;quot;&lt;br /&gt;
! Cooling !! Cap !! Hottest reading !! Source&lt;br /&gt;
|-&lt;br /&gt;
| Water block, full load || 250 W || 50 C || {{Source|handle=leenodie|date=2026-10-26|link=https://discord.com/channels/1518634379604136178/1545982693903306813/1564340979065163910}}&lt;br /&gt;
|-&lt;br /&gt;
| Water block, 360 mm radiator, fans at minimum || 180 W || 45 C || &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/amoghmunikote/170th-Street amoghmunikote/170th-Street]&amp;lt;/span&amp;gt;&lt;br /&gt;
|-&lt;br /&gt;
| Water, general || not given || 50 to 60 C || {{Source|handle=endsjeremy|date=2026-10-20|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1561901936494649345}}&lt;br /&gt;
|-&lt;br /&gt;
| Air, unlocked 64 GB card || 175 W || 60 C core, 65 C HBM || {{Source|handle=rrickk420|date=2026-10-08|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1557800123457736795}}&lt;br /&gt;
|-&lt;br /&gt;
| One 80 mm fan per pair, no duct || 185 W || 63 C || {{Source|handle=c133|date=2026-10-09|link=https://discord.com/channels/1518634379604136178/1528513735575081070/1558160764370690100}}&lt;br /&gt;
|-&lt;br /&gt;
| S12038-4K push only, four cards, cold garage || 200 W || 62 C || {{Source|handle=alanoo|date=2026-10-26|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1564379568801058877}}&lt;br /&gt;
|-&lt;br /&gt;
| Blower at 50 to 60 % || 200 W || 60 C || {{Source|handle=68x0|date=2026-10-15|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1560301937675599944}}&lt;br /&gt;
|-&lt;br /&gt;
| P12 Pro on a shroud || 175 W || 65 C || {{Source|handle=rrickk420|date=2026-10-07|link=https://discord.com/channels/1518634379604136178/1518691940646781070/1557456081607860236}}&lt;br /&gt;
|-&lt;br /&gt;
| Sealed funnel || 150 W || 70 C || {{Source|handle=globalapathy|date=2026-10-07|link=https://discord.com/channels/1518634379604136178/1518691940646781070/1557451493379154061}}&lt;br /&gt;
|-&lt;br /&gt;
| S12038-4K push-pull, 24 C room || 300 W || HBM 72 C || {{Source|handle=wakeupmbrc1|date=2026-10-16|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1560655488331546715}}&lt;br /&gt;
|-&lt;br /&gt;
| P12 Pro push and pull on 3-card plenums, 10 minutes full power || full || 80 C || {{Source|handle=reala7096|date=2026-10-08|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1557593651037737051}}&lt;br /&gt;
|-&lt;br /&gt;
| One card, 6-way inference soak for 10 minutes || 200 W || HBM 84 to 85 C, GPU 78 C || &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/cachenetics/170tune cachenetics/170tune]&amp;lt;/span&amp;gt;&lt;br /&gt;
|-&lt;br /&gt;
| Four cards, GLM-5.3-Flash TP4 || 165 W || HBM 82 to 83 C || &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/PixelML/club-170hx PixelML/club-170hx]&amp;lt;/span&amp;gt;&lt;br /&gt;
|-&lt;br /&gt;
| Eight cards in a server with a fan wall, same cap, by slot || 180 W || 58 to 68 C on two slots per CPU, 81 to 84 C on the other two || {{Source|handle=darkmaniac7|date=2026-10-28|note=lab notes}}&lt;br /&gt;
|-&lt;br /&gt;
| Four idle cards, one 80 mm blower on a printed duct || idle || core 37 to 38 C, memory 41 to 51 C || &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/PixelML/club-170hx PixelML/club-170hx]&amp;lt;/span&amp;gt;&lt;br /&gt;
|-&lt;br /&gt;
| Sandwiched cards with shared intake || under load || 34 to 42 C || {{Source|handle=moliminous|date=2026-10-11|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1558686919033094145}}&lt;br /&gt;
|}&lt;br /&gt;
&lt;br /&gt;
== Reading the sensors ==&lt;br /&gt;
* &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi -q -d TEMPERATURE&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt; {{Source|handle=xeax|date=2026-10-15|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1560253301985906692}}, or for logging &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;nvidia-smi --query-gpu=index,temperature.gpu,temperature.memory,power.draw --format=csv&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt; &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/PixelML/club-170hx PixelML/club-170hx]&amp;lt;/span&amp;gt;. Watch &amp;lt;code&amp;gt;&amp;lt;nowiki&amp;gt;temperature.memory&amp;lt;/nowiki&amp;gt;&amp;lt;/code&amp;gt;: HBM is usually the warmest sensor under load. &amp;lt;span class=&amp;quot;cmpw-source&amp;quot;&amp;gt;Source: [https://github.com/cachenetics/170tune cachenetics/170tune]&amp;lt;/span&amp;gt;&lt;br /&gt;
* The card has about 10 temperature sensors, including one per HBM stack. {{Source|handle=matstatman|date=2026-10-05|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1556770474695069718}} [https://github.com/matstatman/hbmmon matstatman/hbmmon] shows per-stack temperature, but it writes to the HBM debug interface by default and needs a custom driver; use its read-only mode on a stock driver. {{Source|handle=matstatman|date=2026-10-05|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1556758870565593288|repo=https://github.com/matstatman/hbmmon}} (no license file)&lt;br /&gt;
* The 10 GB card&amp;#039;s memory runs a few degrees warmer than the 8 GB card&amp;#039;s (two more half stacks active): 41 C against 37 C at the same 33 W idle after a repaste; before the repaste the gap was 13 C, which pointed at the thermal interface. {{Source|handle=ghostinthedatacenter_87281|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559597067352023152}}&amp;lt;br /&amp;gt;{{Source|handle=colo2442|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559599442166812784}}&amp;lt;br /&amp;gt;{{Source|handle=djpandaman|date=2026-10-13|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1559649510827757569}}&lt;br /&gt;
* A server BMC cannot read the temperature of a card on a generic passive riser, so it will not ramp the fans for it. {{Source|handle=fafinet|date=2026-10-21|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1562300430439157850}}&lt;br /&gt;
&lt;br /&gt;
== Room and inlet temperature ==&lt;br /&gt;
* Your intake air sets the floor. Ivan&amp;#039;s eight-card server raises its power caps only while the inlet is below 24 C and lowers them above 27 C; at about 2 kW into a room, the room became the limit before the fans did. See [[Chassis builds]]. {{Source|handle=darkmaniac7|date=2026-10-27|note=lab notes}}&lt;br /&gt;
* Twelve cards on dedicated circuits with an air conditioner pointed at them is still the warmest and loudest room in @gpmickey&amp;#039;s house. {{Source|handle=gpmickey|date=2026-10-19|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1561664734179364944}}&lt;br /&gt;
* {{Status|Warning}} Do not feed cold winter air or sub-dew-point coolant to the cards: condensation. {{Source|handle=alanoo|date=2026-10-20|link=https://discord.com/channels/1518634379604136178/1518692084729511967/1562111068204044420}}&amp;lt;br /&amp;gt;{{Source|handle=gnasherrr|date=2026-10-26|link=https://discord.com/channels/1518634379604136178/1534370835220004885/1564185826538160159}}&lt;br /&gt;
* Paste and pads matter for the last few degrees; see [[Water cooling]] for opening the card.&lt;br /&gt;
&lt;br /&gt;
== See also ==&lt;br /&gt;
[[Cooling and power]] · [[Fans and ducts]] · [[Water cooling]] · [[Undervolting and power limits]] ·&lt;br /&gt;
[[P-states and idle power]] · [[Troubleshooting]] · [[Tools]]&lt;br /&gt;
&lt;br /&gt;
{{ImportFooter}}&lt;br /&gt;
[[Category:Cooling and power]]&lt;br /&gt;
&lt;br /&gt;
[[Category:8 GB]]&lt;br /&gt;
[[Category:10 GB]]&lt;/div&gt;</summary>
		<author><name>ImportBot</name></author>
	</entry>
</feed>