Archive of posts tagged: deep neural networks
To Sparsify or To Quantize: A Hardware Architecture View
The debate of sparsity versus quantization has made its rounds in the ML optimization community for many years. Now, with the Generative AI revolution, the debate is intensifying. While these might both seem like simple mathematical approximations to an AI researcher,...
AI Software Should be More Like Plain Old Software
A Tale of Two Softwares: In a world where AI is revolutionizing the way we interact with technology, a new type of software emerges: AI Software (AISW). But with great power comes great responsibility, and the systems research community must rise to the challenge of ensuring AISW is as robust, secure, and safe as its predecessor, Plain Old Software (POSW).