diff options
| author | Danilo M. <danix@danix.xyz> | 2026-10-22 13:12:31 +0200 |
|---|---|---|
| committer | Danilo M. <danix@danix.xyz> | 2026-10-22 13:12:31 +0200 |
| commit | e0ad62c5d176d021b2bd782dfe4d9595fa5ebfe1 (patch) | |
| tree | 72cb5b088e8d5eaa98773f6dd36580fd5897b7f1 /README.md | |
| parent | 4738197c3f005ce2f563b7627ab345fb33956ee3 (diff) | |
| download | strata-docker-e0ad62c5d176d021b2bd782dfe4d9595fa5ebfe1.tar.gz strata-docker-e0ad62c5d176d021b2bd782dfe4d9595fa5ebfe1.zip | |
Gyro-M does not fit a 12 GB B580 with 31 GiB RAM on the xe
stream-experts path: the engine refused with 5,309 experts neither
in VRAM nor in the pinned RAM mirror. Gyro-S fits and answers at
22-29 tok/s, but hit UR_RESULT_ERROR_DEVICE_LOST in the verify step
on 2 of about 6 requests.
AGENTS.md records the upstream fake-RAM bug that adds --ple-io ram
to Gyro configs, the measurements, the suspected spin-bound cause
and the untried fixes. Logs are now ignored.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 8 |
1 files changed, 4 insertions, 4 deletions
@@ -4,7 +4,7 @@ Run [Strata](https://github.com/Niko1221/Strata) on an Intel Arc card under Slackware, without installing oneAPI on the host. It wraps upstream's documented Docker route: the SYCL engine is built and run inside the `strata-sycl-dev` image, the setup and server run on the host. Defaults to an -Arc B580 and the Gyro-M model. +Arc B580 and the Gyro-S model. Upstream's Intel engine is experimental. Expect rough edges. @@ -14,8 +14,8 @@ Upstream's Intel engine is experimental. Expect rough edges. usable by your user - Docker, your user in the `docker` group - Python 3.10+ with venv, git -- Disk: about 13 GB for the image, about 92 GB for Gyro-M -- Memory: Gyro-M needs about 35 GB of RAM and VRAM together +- Disk: about 13 GB for the image, about 58 GB for Gyro-S +- Memory: Gyro-S needs about 21 GiB of free RAM for the expert mirror ## Usage @@ -23,7 +23,7 @@ Upstream's Intel engine is experimental. Expect rough edges. ./strata-docker fetch # clone Strata, check out the pinned tag (v0.2.2) ./strata-docker image # build the strata-sycl-dev image (~6 min, 13 GB) ./strata-docker build # build the engine for bmg-g21 (~3 min) -./strata-docker setup # download Gyro-M and start serving +./strata-docker setup # download Gyro-S and start serving ./strata-docker setup --check # what fits, changes nothing ``` |