diff options
| -rw-r--r-- | AGENTS.md | 6 |
1 files changed, 6 insertions, 0 deletions
@@ -253,6 +253,12 @@ changing that component. The ones that generalise: `LazyLoader` toggled off and on (`assistant/Assistant.qml`). A dropped connection is different: `disconnected` clears the socket, so a later `connected = true` works, until one of those attempts fails. +- **llama-server's `/slots?model=<id>` loads the model.** In router mode a + slot query for an unloaded model autoloads it into VRAM, so a status probe + is not read-only: one during the `ai` module's design put Gemma back on the + GPU. Pass `autoload=false`, which answers 400 `model is not loaded` instead. + Checking `/models` for `loaded` first is not enough on its own, because the + model can unload between the two requests. ## Theme |