# ai

What is using the local AI stack, and start/stop for the projects built on it.

The tile counts running apps and names any engine that is generating, or says
`Idle`. The page lists the two engines, then the apps.

## Engines

llama.cpp (`llama-server`, router mode, port 8181) and stable-diffusion.cpp
(`sd-server`, started by `~/bin/sd-webui`). Both rows are read-only: each
engine also serves a web UI, and stopping it would take that down.

llama's state comes from its API: `/models` for the loaded model, then
`/slots?model=<id>&autoload=false` for whether a slot is processing. The
`autoload=false` matters: a plain `/slots?model=` on an unloaded model loads
it into VRAM, which is how this was found.

The sd row covers two processes. A running `sd-cli`, the one-shot runs
fanfictioner makes, reads up and generating with its model marked `(sd-cli)`,
whatever the web UI is doing: it holds VRAM for as long as it lives. The first
version watched only `sd-server` and showed the engine down mid-run.

sd-server has no progress endpoint. Its log, `~/.cache/sd-server.log`, streams
progress bars while it generates, so the row reads busy while the log was
written in the last 5s. A step slower than that reads idle.

## Apps

| App | Status | Start | Stop |
| --- | --- | --- | --- |
| desktop-assistant | `assistant.sh status` | `assistant.sh start` | `assistant.sh stop` |
| local chat | `llamachat --ping` | `llamachat --daemon` | `llamachat --quit` |
| imggen | `imggen status` | `imggen start` (default model) | `imggen stop` |
| fanfictioner | `pgrep` on `python3 .../fanfictioner` | none | TERM its children, then it, by pid |

Each runs detached, so no exit code comes back; the next poll shows whether it
worked. `assistant.sh status` fails when either the assistant or its overlay
is down, so a dead overlay reads as stopped and Start restarts it.

## Service lifetime

`alwaysActive: false`. `ai-state.sh` runs every 3s while the drawer is open,
gated on the tile's lifetime the same way kdeconnect is, and 1s after any
action.

## Test

    ./test-ai-state.sh

Stubs every external command on PATH; touches nothing live.