All in on MatMul? Don’t Put All Your Tensors in One Basket!
Matrix multiplication dominates AI hardware and research. Betting everything on MatMul risks an innovation monoculture — it’s time to diversify our compute bets.
Archive of posts tagged: Moore’s Law
Hitting an Accelerator Wall: When Specialized Chips Meet the End of Moore’s Law
Background These are exciting and challenging times for computer architects. The looming end of Moore’s law and the breakdown of Dennard scaling force everybody to put on their thinking caps and envision what future processors will look like when transistors...Subscribe
