me/env-ansible
1
1 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

llm, add beginning of benchmark data which accidentally got cancelled.

Browse Source
This commit is contained in:
me committed 2026-10-24 20:55:41 -07:00
1 parent 9e75d9b981
commit 4597151bbf
1 file changed
+58
Download Patch File Download Diff File Expand all files Collapse all files
tasks/workstation/linux/software/llm.md
+58
View File
@@ -105,6 +105,64 @@ Number of physical cores is 8, hyperthreaded to 16, but supposedly the emulated
cores are not very useful to LLMs. Try only using between 6 and 8 when possible.
Research says it is not worth enabling the iGPU for Intel XE, CPUs are better.
## Benchmark
### System
```
$ fastfetch
' ling@good-rhino
'o' ---------------
'ooo' OS: Artix Linux x86_64
'ooxoo' Host: NV4xPZ (v2.1)
'ooxxxoo' Kernel: Linux 7.2.11-artix1-1
'oookkxxoo' Uptime: 10 hours, 3 mins
'oiioxkkxxoo' Packages: 42 (flatpak), 1502 (pacman)
':;:iiiioxxxoo' Shell: bash 5.3.20
`'.;::ioxxoo' Display (AUO683D): 1920x1080 in 14", 60 Hz [Built-in]
'-. `':;jiooo' Window Manager: i3 4.25.1 (X11)
'oooio-.. `'i:io' Theme: Adwaita-dark [GTK2/3/4]
'ooooxxxxoio:,. `'-;' Icons: Adwaita [GTK2/3/4]
'ooooxxxxxkkxoooIi:-. `' Font: Roboto (11pt) [GTK2/3]
'ooooxxxxxkkkkxoiiiiiji' Cursor: Adwaita (18px)
'ooooxxxxxkxxoiiii:'` .i' Terminal: kitty 0.48.2
'ooooxxxxxoi:::'` .;ioxo' Terminal Font: DejaVuSansMono (11pt)
'ooooxooi::'` .:iiixkxxo' CPU: 12th Gen Intel(R) Core(TM) i7-1260P (8+8) @ 4.70 GHz
'ooooi:'` `'';ioxxo' GPU: Intel Iris Xe Graphics @ 1.40 GHz [Integrated]
'i:'` '':io' Memory: 28.11 GiB / 62.63 GiB (45%)
'` `' Swap: 1.12 GiB / 68.89 GiB (2%)
Disk (/): 552.03 GiB / 847.71 GiB (65%) - ext4
Local IP (wg0-mullvad): 10.131.3.55/32
Battery (BAT): 95% [AC Connected]
Locale: en_US.UTF-8
```
### Main Models and Parameters
```
$ export QUIET=true
$ ollama-test "64000 128000" "4 7 0" 0 "qwen3.5:27b qwen3.5:35b qwen3.6:27b qwen3.6:35b qwen3.8:27b devstral-small-2:24b"
| Model | HDD | Context | RAM | Threads | Processor | Speed (t/s) | Time (s) |
| :------------------------ | -----: | -------: | -----: | ------: | --------: | ----------: | -------: |
| qwen3.5:27b | 17GB | 64000 | 22GB | 4 | 100%CPU | 2.12 | 256 |
| qwen3.5:35b | 22GB | 64000 | 23GB | 4 | 100%CPU | 13.26 | 42 |
| qwen3.6:27b | 17GB | 64000 | 18GB | 4 | 100%CPU | 2.97 | 102 |
| qwen3.6:35b | 22GB | 64000 | 22GB | 4 | 100%CPU | 13.91 | 26 |
| qwen3.8:27b | 17GB | 64000 | 19GB | 4 | 100%CPU | 1.76 | 49 |
| devstral-small-2:24b | 15GB | 64000 | 26GB | 4 | 100%CPU | 2.76 | 93 |
| qwen3.5:27b | 17GB | 64000 | 22GB | 7 | 100%CPU | 2.08 | 167 |
| qwen3.5:35b | 22GB | 64000 | 23GB | 7 | 100%CPU | 13.61 | 20 |
| qwen3.6:27b | 17GB | 64000 | 18GB | 7 | 100%CPU | 3.08 | 56 |
| qwen3.6:35b | 22GB | 64000 | 22GB | 7 | 100%CPU | 11.13 | 36 |
| qwen3.8:27b | 17GB | 64000 | 19GB | 7 | 100%CPU | 2.23 | 43 |
| devstral-small-2:24b | 15GB | 64000 | 26GB | 7 | 100%CPU | 2.36 | 88 |
| qwen3.5:27b | 17GB | 64000 | 22GB | 0 | 100%CPU | 2.11 | 156 |
| qwen3.5:35b | 22GB | 64000 | 23GB | 0 | 100%CPU | 13.68 | 37 |
| qwen3.6:27b | 17GB | 64000 | 18GB | 0 | 100%CPU | 2.68 | 85 |
| qwen3.6:35b | 22GB | 64000 | 22GB | 0 | 100%CPU | 13.83 | 39 |
| qwen3.8:27b | 17GB | . . . .
```
## Tokens per CPU Count
Verifying that 8 or less cores gives better performance (less memory issues).