Archive of posts tagged: Memory
The Hitchhiker’s Guide to Coherent Fabrics: 5 Programming Rules for CXL, NVLink, and InfinityFabric
This is the second article in the series, following our first blog in Dec 2023: Tuning the Symphony of Heterogeneous Memory Systems Modern applications are increasingly memory hungry. Applications like Large-Language Models (LLM), in-memory databases, and data...Processing-in-Memory Tutorials: Experiences from Past Two Years and Thoughts Looking Forward
Processing-in-Memory (PIM) is a computing paradigm that aims to overcome the data movement bottleneck (i.e., wasted execution cycles and energy, resulting from the back-and-forth data movement between memory units and compute units) by making memory (and storage)...
Current status, needs, and challenges in Heterogeneous and Composable Memory from the HCM workshop (HPCA’23)
Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging...Fast memcpy, A System Design
When I worked at Google, fleet-wide profiling revealed that 25-35% of all CPU time was spent just moving bytes around: memcpy, strcmp, copying between user and kernel buffers in network and disk I/O, hidden copy-on-write in soft page faults, checksumming, compressing,...Subscribe
