diff --git a/tasks/workstation/linux/software/ai/README.md b/tasks/workstation/linux/software/ai/README.md index 42a6679..61b8322 100644 --- a/tasks/workstation/linux/software/ai/README.md +++ b/tasks/workstation/linux/software/ai/README.md @@ -197,6 +197,10 @@ $ ollama-test "64000 300000" "4 7 0" 0 "qwen3.5:35b qwen3.6:35b qwen3.8:27b devs Checking if the context affects the speed of the model. Seems negligible, way less than changing the threads or iGPU. +```console +$ ollama-test "16000 32000 64000 128000 256000 264000" "4" "0" "qwen3.5:35b qwen3.6:35b devstral-small-2:24b" +``` + | Model | HDD | Context | RAM | Threads | iGPU | Processor | Speed (t/s) | Time (s) | | :------------------------ | -----: | -------: | -----: | ------: | ---: | --------: | ----------: | -------: | | qwen3.5:35b | 22GB | 16000 | 22GB | 4 | 0 | 100%CPU | 14.57 | 50 |