Workshop
Notes from where I run real things on real hardware.
-
What an LLM Server Feels Like Under Load
Two 7B models, one consumer GPU. Same hardware, very different things to use. What that actually feels like.
Notes from where I run real things on real hardware.
Two 7B models, one consumer GPU. Same hardware, very different things to use. What that actually feels like.