diff options
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 10 |
1 files changed, 7 insertions, 3 deletions
@@ -388,11 +388,15 @@ searching again. A local 9B will otherwise keep searching when it is unsure. The default is 1 rather than 2 because of an upstream limitation. The first tool call of a turn arrives as a proper `tool_calls` delta, but a second one, -issued after the model has seen the first set of results, comes back as +issued after the model has seen the first set of results, often comes back as literal `<tool_call><function=web_search>` text inside the thinking instead. There is no structured call to act on, so the turn ends with an empty reply. -Observed with Qwen3.5-9B through llama.cpp's router; raise the cap if your -model and build handle follow-up calls properly. + +Observed with Qwen3.5-9B through llama.cpp's router. Newer builds parse +follow-up calls some of the time (1 in 5 on b10208) rather than never, so +this may be worth retesting; raise the cap if your model and build handle +them reliably. Enabling more search engines helps more than raising the cap, +since a first round that returns plenty removes the reason to search twice. Failures do not abort the turn. A timeout, a refused connection, a non-JSON response or zero results all come back to the model as a tool result saying |