diff options
| author | Danilo M. <danix@danix.xyz> | 2026-08-10 18:24:24 +0200 |
|---|---|---|
| committer | Danilo M. <danix@danix.xyz> | 2026-08-10 18:24:24 +0200 |
| commit | c27fe5e9334572e00fedd4aa67d90b236c5da3b7 (patch) | |
| tree | 26bf7cc94ff18637488e084c369f22e7cf396d61 /docs | |
| parent | 4a22fe71f8414328d8cc1071619182468c3443e4 (diff) | |
| download | llamachat-c27fe5e9334572e00fedd4aa67d90b236c5da3b7.tar.gz llamachat-c27fe5e9334572e00fedd4aa67d90b236c5da3b7.zip | |
feat: fan model listing out across providers and route by id
A provider that is unreachable or whose filter matched nothing is
reported rather than fatal: local models must stay usable when the
network is down. Clients are built on demand so a key is resolved only
when that provider is really used.
The model listing carries its own timeout, separate from the per-turn
one: the picker has to populate fast, and a dead cloud provider must
not hang it for minutes. Client.models() takes list_timeout (default 30)
and uses httpx.Timeout(list_timeout, connect=5), and MultiClient threads
its own list_timeout through to each listing call. The fan-out stays
serial on purpose: KeyResolver._cache is unlocked and only safe while
every caller resolves on the GUI thread.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Diffstat (limited to 'docs')
0 files changed, 0 insertions, 0 deletions
