Google's new TurboQuant algorithm speeds up AI memory 8x, cutting costs by 50% or more

Within 24 hours of the release, community members began porting the algorithm to popular local AI libraries like MLX for Apple Silicon and llama.cpp.
SDxCentral

TurboQuant: Did Google just drop a compression algorithm capable of stemming RAMageddon?

Google thinks it's found the answer, and it doesn't require more or better hardware. Originally detailed in an April 2025 paper, TurboQuant is an advanced compression algorithm that’s going viral over ...

Google's TurboQuant compression tech cuts LLM memory use by 6x with no accuracy loss

The biggest memory burden for LLMs is the key-value cache, which stores conversational context as users interact with AI chatbots. The cache grows as conversations lengthen, ...

MU, WDC, SNDK fall: Why Google’s TurboQuant is rattling memory stocks

SanDisk Corporation (NASDAQ:SNDK) fell 5.7%, Micron Technology (NASDAQ:MU) dropped 3%, Western Digital (NASDAQ:WDC) declined ...
Tom's Hardware on MSN

Google's TurboQuant reduces AI LLM cache memory capacity requirements by at least six times

The algorithm achieves up to an eight-times performance boost over unquantized keys on Nvidia H100 GPUs.

What is Google's new AI algorithm that has sent stocks of biggest memory makers plummeting?

Google's new TurboQuant algorithm drastically cuts AI model memory needs, impacting memory chip stocks like SK Hynix and ...