llm, add longer tineout for qwen, add a few more documentation links.
This commit is contained in:
@@ -23,6 +23,8 @@
|
||||
# - https://docs.ollama.com
|
||||
# - https://docs.ollama.com/faq#setting-environment-variables-on-linux
|
||||
# - https://modelpiper.com/blog/ollama-environment-variables
|
||||
# - https://qwenlm.github.io/qwen-code-docs/en/users/configuration/settings/#environment-variables--env-files
|
||||
# - https://qwenlm.github.io/qwen-code-docs/en/users/qwen-serve/
|
||||
|
||||
# Currently only testing this on Arch based distros (pacman).
|
||||
- name: Workstation | Linux | Software | LLMs
|
||||
@@ -590,6 +592,7 @@
|
||||
content: |
|
||||
#!/bin/sh -e
|
||||
exec 2>&1
|
||||
export QWEN_STREAM_IDLE_TIMEOUT_MS=6000000
|
||||
exec chpst -u {{ user }} -C {{ user_user.home }}/Code qwen serve
|
||||
mode: "0755"
|
||||
|
||||
|
||||
Reference in New Issue
Block a user