by Vishakha Ramani on Sep 9, 2026 | Tags: AI coding agents, AI-native systems research, LLM serving, performance modeling, systems research methodology
Lessons from using an AI coding agent in LLM systems research This project began with a routing problem. When an LLM request arrives, the system must decide which GPU will execute prefill and which GPU will execute decode. The same GPU can execute both phases....
Read more...
