Computer Architecture Today

Informing the broad computing community about current activities, advances and future directions in computer architecture.
Archive of posts tagged: Machine Learning
Compressing LLMs without Compromise

Compressing LLMs without Compromise

LLM execution requires moving gigabytes of data, which includes static model weights, the generated KV cache, and other intermediate representations. Depending on the deployment, this may involve communication across the network, PCIe links, accelerator links (e.g.,...

Read more...

All in on MatMul? Don’t Put All Your Tensors in One Basket!

All in on MatMul? Don’t Put All Your Tensors in One Basket!

Matrix multiplication dominates AI hardware and research. Betting everything on MatMul risks an innovation monoculture — it’s time to diversify our compute bets.

Read more...