me/env-ansible
1
1 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

roleplays, go up to 7 threads due to benchmark data. 8 is very marginal, leave it for the system. 4 is great for MoE tokens/sec but 7 is still a bit faster in overall response time.

Browse Source
This commit is contained in:
me committed 2026-10-21 05:28:05 -07:00
1 parent 6411d4792a
commit 74789ba70c
1 file changed
+9 -9
Download Patch File Download Diff File Expand all files Collapse all files
files/settings/open_webui_roleplays.json
+9 -9
View File
@@ -8,7 +8,7 @@
"params": {
"custom_params": {},
"num_ctx": 256000,
"num_thread": 6,
"num_thread": 7,
"system": "Please use the attached Knowledge Base files as your personality."
},
"meta": {
@@ -77,7 +77,7 @@
"params": {
"custom_params": {},
"num_ctx": 256000,
"num_thread": 6,
"num_thread": 7,
"system": "Please use the attached Knowledge Base files as your personality."
},
"meta": {
@@ -146,7 +146,7 @@
"params": {
"custom_params": {},
"num_ctx": 256000,
"num_thread": 6,
"num_thread": 7,
"system": "Please use the attached Knowledge Base files as your personality."
},
"meta": {
@@ -215,7 +215,7 @@
"params": {
"system": "Please use the attached Knowledge Base files as your personality.",
"custom_params": {},
"num_thread": 6,
"num_thread": 7,
"num_ctx": 32000
},
"meta": {
@@ -279,7 +279,7 @@
"params": {
"system": "Please use the attached Knowledge Base files as your personality.",
"custom_params": {},
"num_thread": 6,
"num_thread": 7,
"num_ctx": 32000
},
"meta": {
@@ -343,7 +343,7 @@
"params": {
"system": "Please use the attached Knowledge Base files as your personality.",
"custom_params": {},
"num_thread": 6,
"num_thread": 7,
"num_ctx": 64000
},
"meta": {
@@ -407,7 +407,7 @@
"params": {
"custom_params": {},
"num_ctx": 256000,
"num_thread": 6,
"num_thread": 7,
"system": "Please use the attached Knowledge Base files as your personality."
},
"meta": {
@@ -476,7 +476,7 @@
"params": {
"custom_params": {},
"num_ctx": 192000,
"num_thread": 6,
"num_thread": 7,
"system": "Please use the attached Knowledge Base files as your personality."
},
"meta": {
@@ -545,7 +545,7 @@
"params": {
"system": "Please use the attached Knowledge Base files as your personality.",
"custom_params": {},
"num_thread": 6,
"num_thread": 7,
"num_ctx": 32000
},
"meta": {