diff options
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/superpowers/specs/2026-10-23-cloud-models-design.md | 7 |
1 files changed, 5 insertions, 2 deletions
diff --git a/docs/superpowers/specs/2026-10-23-cloud-models-design.md b/docs/superpowers/specs/2026-10-23-cloud-models-design.md index 8a581ee..d2270af 100644 --- a/docs/superpowers/specs/2026-10-23-cloud-models-design.md +++ b/docs/superpowers/specs/2026-10-23-cloud-models-design.md @@ -69,8 +69,11 @@ ids contain `/` and sometimes `:` (OpenRouter's `:free`). asks for a model" becomes "only for a model the user picked for this chat". `ctx` still carries the model actually answering. - **Cloud model.** Same request body minus `chat_template_kwargs` (strict - providers reject unknown fields). No `/props`: `ctx` max is 0 and the - canvas shows used tokens only, from `usage`. Reasoning deltas are read + providers reject unknown fields). No `/props`: `ctx` max comes from the + provider's `/models`, `max_model_len` (vLLM, Hetzner) or + `context_length` (OpenRouter), read when the chat's model changes; 0 + when neither is there, and the canvas then shows used tokens only. A + chat's attachment budget uses the same size. Reasoning deltas are read from `reasoning_content` (llama-server) or `reasoning` (OpenRouter). `temperature` from config applies when set. Vision and audio are unknown for cloud models (`/models` does not report them), so |