Commit Graph
112 Commits
Author SHA1 Message Date
me 43dc65a84b llm, mount etc dirs for Java security policy, add needed packages to compile Android and Flutter. 2026-10-24 15:53:29 -07:00
me 2a7fa98825 llm, move projects and SDK back to user so that compilation paths do not need changed. 2026-10-24 15:17:13 -07:00
me ef9566c76c llm, move some functions to env-shared project. 2026-10-24 10:55:11 -07:00
me 41f306f7d7 llm, add another alias for restarting AI services. 2026-10-23 19:03:16 -07:00
me 75503d762b llm, extend keep alive time again since context gets unloaded too, remove DEBUG output from ollama log, use .bashrc rather than profiles since Docker is not creating those, create AGENTS.md in user root, make the JDK directory read only to prevent AI from tampering. 2026-10-23 17:43:48 -07:00
me c341d216ad llm, maintain env vars and PATH changes in the AI Sandbox folder. 2026-10-22 18:03:32 -07:00
me f6fd08f966 llm, add a safeguard when a model causes swap-stopper to reset ollama. 2026-10-22 11:58:16 -07:00
me 96dd0118fa llm, add SDK homes for open-terminal. 2026-10-22 09:48:19 -07:00
me d5e3a57f56 llm, add a few models for mistral-small4 but they are too large or not the correct format for ollama, a few more edits to ollama_threads. 2026-10-21 09:56:14 -07:00
me bd7112e8d5 llm, filter out the less useful tests in ollama_threads. Should help save a lot of time, maybe up to 60-75% since they were the slower ones. 2026-10-21 07:27:28 -07:00
me 40d9a7252e llm, if Internet is available, pull extra packages for open-terminal. 2026-10-21 06:06:41 -07:00
me 6482dd123d llm, change ollama_threads to use a better method of determining the number of cores to test, also fix output. 2026-10-21 05:43:37 -07:00
me c604859947 llm, add elapsed time to ollama_threads. 2026-10-21 05:23:41 -07:00
me 7f7f2a2edb llm, fix context sending in ollama_threads. 2026-10-21 04:55:01 -07:00
me 92be32345a llm, add context param to ollama_threads. 2026-10-21 04:51:46 -07:00
me 5719ec6b60 llm, add optional open-terminal package list, helpful but required Internet, may have to do an Internet check and then choose which docker run command to execute. Also fix and enhance the ollama_thread checker. 2026-10-21 04:47:16 -07:00
me 85e60ef60c llm, improve the thread testing output and also make the the ansible variable is always an int. 2026-10-21 03:03:24 -07:00
me 5620e5a223 llm, add function for benchmarking whether more threads adds latency. 2026-10-21 02:57:12 -07:00
me 870a99804a llm, add OLLAMA_NUM_THREADS which was proposed but rejected so far. 2026-10-21 02:03:37 -07:00
me bec4c919d4 llm, stop using pull=always because then network is required to start the container. 2026-10-20 16:36:44 -07:00
me 52d7ae3d86 llm, move bulk comments to an md file and start adding prompts to use in Open WebUI. 2026-10-20 10:16:40 -07:00
me a892aae620 llm, fix open-terminal docker syntax. 2026-10-20 10:16:15 -07:00
me a823d4ae63 llm, fix open-terminal port control. 2026-10-18 10:27:10 -07:00
me 8311427506 llm, make the ollama_usage output much fancier, more report-like. 2026-10-18 10:26:56 -07:00
me 797744d9fe llm, add function which gets the model sizes, both disk and memory. 2026-10-18 09:00:25 -07:00
me 3e1291d1f9 Centralize the /var/log/*/config code. 2026-10-17 14:59:37 -07:00
me bcdb47ac74 llm, add shortcut to restart LLM related software. 2026-10-17 14:51:28 -07:00
me c8bd5ee1e4 llm, fix open-webui missing backslash after pull option. 2026-10-17 14:38:17 -07:00
me 36a80041f3 llm, no longer bother with autocomplete in Continue, not getting any functionality since on 100% CPU so it's just draining resources. 2026-10-17 14:37:03 -07:00
me 41d01c70f5 llm, implement the qwen code key variable. 2026-10-17 13:14:59 -07:00
me 9f82c136e9 llm, add open-terminal as a test bed for Open WebUI LLMs, so that they can read/write files and execute commands in a safe way. 2026-10-17 13:08:50 -07:00
me 89fdb52fcc llm, move Docker section out of Open WebUI since it's now shared. 2026-10-17 13:08:12 -07:00
me 8a2a723d4b llm, continue dropping keep alive since tools which use LLMs correctly manage this themselves. 2026-10-17 12:01:57 -07:00
me 1e8aa6956f llm, always update open-webui. 2026-10-17 11:46:30 -07:00
me c8f32b917f llm, try mounting user's Code directory in the Open WebUI container. 2026-10-17 08:47:16 -07:00
me b1ebe20874 llm, leave the rm of the docker container to the explicit commands, rather than also expecting run to take care of it. 2026-10-17 08:42:24 -07:00
me be53012c48 llm, adjust some more parameters and try reducing complexity of qwen config a bit to see if that's why it's stopped working decently, move runit script to system.. 2026-10-17 08:18:18 -07:00
me c709930bf0 llm, add model section back to qwen settings in case that's why it's freaking out. 2026-10-16 17:47:50 -07:00
me 7e0df2ee13 llm, remove model section from qwen settings. 2026-10-16 11:52:09 -07:00
me 6a446a8383 llm, handle max_tokens a little more dynamically, likely only affects the smaller models. 2026-10-16 09:46:46 -07:00
me 629f7c424d llm, add the actual context values rather than rounding down. 2026-10-16 09:34:08 -07:00
me 0a0b85e66d llm, increase context as to not hinder models from achieving their intended abilities. Keep max_tokens limited where applicable. 2026-10-16 09:23:58 -07:00
me 2706011fa0 llm, add moe tag to a few more model provider names. 2026-10-16 09:10:06 -07:00
me 669095e7cb llm, add more memorable aliases for the fancy ollama show loop. 2026-10-16 09:08:47 -07:00
me 8ed0aca797 llm, add a temperature for qwen code providers. 2026-10-16 07:54:34 -07:00
me 79d6f53424 llm, add additional qwen code config to help tame the models. 2026-10-15 18:01:02 -07:00
me 79a8c32584 llm, add longer tineout for qwen, add a few more documentation links. 2026-10-15 17:28:13 -07:00
me 0f4fe291b2 llm, edit provider suffixes. 2026-10-15 12:07:56 -07:00
me 490df1e24c llm, use underscores for model names in qwen, not spaces. 2026-10-14 11:27:42 -07:00
me b26ead5577 llm, fix extra space in provider name. 2026-10-14 11:05:34 -07:00