GPU Throttling Cripples Linux on Nvidia RTX Spark Laptops
Original source
Nvidia RTX Spark encrypted firmware slows inference speed to 35% on Linux
Hacker News →Linux runs on RTX Spark laptops with GPU acceleration, but plugging in the device triggers severe clock throttling. GPU frequency drops from over 2 GHz on Windows to around 780 MHz on Linux, reducing inference speed from approximately 65 tokens per second to under 14 on a 120-billion-parameter model.
The throttling stems from Nvidia’s Platform Controllers and Framework, firmware that manages shared CPU-GPU power delivery on laptops. Its power configuration is encrypted and readable only by Windows; Linux lacks the decryption key. Testing confirmed this by disabling the controller in Windows, which immediately reproduced the slowdown. Notably, unplugged Linux maintains normal performance, proving the issue is power management policy rather than thermal or driver limitations.
Dual-booting Linux requires firmware configuration from Windows and kernel customization to detect hardware. WSL provides an immediate workaround, inheriting Windows’ driver stack and maintaining full GPU performance while still running Linux-first AI frameworks. A complete fix requires Nvidia to implement equivalent power management in its Linux driver.
Read the full article
Continue reading at Hacker News →This is an AI-generated summary. Read the original for the full story.