From 4fd12ce45e03aac39158c47ad570ddd4b62a1860 Mon Sep 17 00:00:00 2001 From: Hyperling Date: Wed, 21 Oct 2026 02:43:07 -0700 Subject: [PATCH] llm, add details about the workstation being used. --- tasks/workstation/linux/software/llm.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/tasks/workstation/linux/software/llm.md b/tasks/workstation/linux/software/llm.md index 6e0ab9f..a74e68b 100644 --- a/tasks/workstation/linux/software/llm.md +++ b/tasks/workstation/linux/software/llm.md @@ -86,6 +86,11 @@ current task at hand. Can easily handle multi-file projects. 2026-10-18, checking the actual RAM usage of the models... +Main laptop has about 60GB of headroom, prefer only using 55GB to be safe. +Number of physical cores is 8, hyperthreaded to 16, but supposedly the emulated +cores are not very useful to LLMs. Try only using between 6 and 8 when possible. +Research says it is not worth enabling the iGPU for Intel XE, CPUs are better. + ### `ollama_sizes m 16000` | Model Name | HDD (ls) | Context | RAM (ps) |