Commit Graph
1289 Commits
Author SHA1 Message Date
me 5620e5a223 llm, add function for benchmarking whether more threads adds latency. 2026-10-21 02:57:12 -07:00
me 4fd12ce45e llm, add details about the workstation being used. 2026-10-21 02:43:07 -07:00
me 14fdc1f740 llm, add more size testing data. 2026-10-21 02:32:55 -07:00
me 1adf4db6ee llm, wrap the personality prompts. 2026-10-21 02:30:04 -07:00
me 870a99804a llm, add OLLAMA_NUM_THREADS which was proposed but rejected so far. 2026-10-21 02:03:37 -07:00
me 2ff0ccd392 llm.md, finish the prompts for now. 2026-10-20 17:10:13 -07:00
me bec4c919d4 llm, stop using pull=always because then network is required to start the container. 2026-10-20 16:36:44 -07:00
me 1ad4f642db llm, continue working on the prompts. 2026-10-20 11:56:23 -07:00
me 52d7ae3d86 llm, move bulk comments to an md file and start adding prompts to use in Open WebUI. 2026-10-20 10:16:40 -07:00
me a892aae620 llm, fix open-terminal docker syntax. 2026-10-20 10:16:15 -07:00
me a823d4ae63 llm, fix open-terminal port control. 2026-10-18 10:27:10 -07:00
me 8311427506 llm, make the ollama_usage output much fancier, more report-like. 2026-10-18 10:26:56 -07:00
me 797744d9fe llm, add function which gets the model sizes, both disk and memory. 2026-10-18 09:00:25 -07:00
me 4ae411584e insgtall, fix lint warning. 2026-10-17 17:19:33 -07:00
me 2dccea21ae root, set the mode directly to avoid lint issues. 2026-10-17 17:18:51 -07:00
me 32916ad470 header, name most the include_tasks and reorder based on subgroups, refactoring a few file locations in some instances. 2026-10-17 17:17:49 -07:00
me 8b4329d129 header, add tunnel. 2026-10-17 17:13:49 -07:00
me edffe124fd services, set modes of edited files. 2026-10-17 17:01:59 -07:00
me 1de11bc2d9 tunnel, fix the ssh command. 2026-10-17 16:57:25 -07:00
me 44a0463ab8 tunnel, enable the service and fix folder permissions. 2026-10-17 16:52:04 -07:00
me 9a1004dfb9 provision, refactor and ensure false keys are actually False. 2026-10-17 16:47:02 -07:00
me 607129e1c2 tunnel, fix outer if statement. 2026-10-17 16:46:37 -07:00
me 1278c5020f tunnel, implement the playbook. 2026-10-17 16:24:10 -07:00
me 11cac42df8 provision, add section for tunnel. 2026-10-17 16:21:21 -07:00
me feb1985755 Add a tunnel file for forwarding ports as a runit service. 2026-10-17 15:35:03 -07:00
me 99965a1df2 ssh, allow tcp forwarding so that gateway works properly when pushing local ports to the domain. 2026-10-17 15:23:01 -07:00
me 4de2772ad0 ssh, allow gateway ports. 2026-10-17 15:05:50 -07:00
me 3e1291d1f9 Centralize the /var/log/*/config code. 2026-10-17 14:59:37 -07:00
me bcdb47ac74 llm, add shortcut to restart LLM related software. 2026-10-17 14:51:28 -07:00
me c8bd5ee1e4 llm, fix open-webui missing backslash after pull option. 2026-10-17 14:38:17 -07:00
me 36a80041f3 llm, no longer bother with autocomplete in Continue, not getting any functionality since on 100% CPU so it's just draining resources. 2026-10-17 14:37:03 -07:00
me 41d01c70f5 llm, implement the qwen code key variable. 2026-10-17 13:14:59 -07:00
me 9f82c136e9 llm, add open-terminal as a test bed for Open WebUI LLMs, so that they can read/write files and execute commands in a safe way. 2026-10-17 13:08:50 -07:00
me 89fdb52fcc llm, move Docker section out of Open WebUI since it's now shared. 2026-10-17 13:08:12 -07:00
me 98c6d47d7f provision, add params for open-terminal, plus an optional key for qwen code. 2026-10-17 12:55:27 -07:00
me 8a2a723d4b llm, continue dropping keep alive since tools which use LLMs correctly manage this themselves. 2026-10-17 12:01:57 -07:00
me 1e8aa6956f llm, always update open-webui. 2026-10-17 11:46:30 -07:00
me c8f32b917f llm, try mounting user's Code directory in the Open WebUI container. 2026-10-17 08:47:16 -07:00
me b1ebe20874 llm, leave the rm of the docker container to the explicit commands, rather than also expecting run to take care of it. 2026-10-17 08:42:24 -07:00
me be53012c48 llm, adjust some more parameters and try reducing complexity of qwen config a bit to see if that's why it's stopped working decently, move runit script to system.. 2026-10-17 08:18:18 -07:00
me c709930bf0 llm, add model section back to qwen settings in case that's why it's freaking out. 2026-10-16 17:47:50 -07:00
me 7e0df2ee13 llm, remove model section from qwen settings. 2026-10-16 11:52:09 -07:00
me 6a446a8383 llm, handle max_tokens a little more dynamically, likely only affects the smaller models. 2026-10-16 09:46:46 -07:00
me bedfbe566d rc, add shortcut to restart a service then immediately follow its log. 2026-10-16 09:37:54 -07:00
me 629f7c424d llm, add the actual context values rather than rounding down. 2026-10-16 09:34:08 -07:00
me 0a0b85e66d llm, increase context as to not hinder models from achieving their intended abilities. Keep max_tokens limited where applicable. 2026-10-16 09:23:58 -07:00
me 2706011fa0 llm, add moe tag to a few more model provider names. 2026-10-16 09:10:06 -07:00
me 669095e7cb llm, add more memorable aliases for the fancy ollama show loop. 2026-10-16 09:08:47 -07:00
me 13f20a4e98 packages, add a shell_check, AUR tasks need to be changed similar to android.yml where it echoes what was truly done so we know if it is OK, CHANGED, FAILED, etc. 2026-10-16 09:01:29 -07:00
me cab2013a97 packages, add English and Spanish dictionaries for workstations. 2026-10-16 08:53:16 -07:00