use supported TEI 1.9 options

This commit is contained in:
Codex
2026-09-18 00:32:21 -07:00
parent 9e9d130f61
commit 9035312208
2 changed files with 2 additions and 24 deletions
+2 -2
View File
@@ -8,8 +8,8 @@ Arcane-managed TEI services on unRaid GPU0 for the production Hindsight VM.
| Reranker | `Alibaba-NLP/gte-multilingual-reranker-base` | `http://192.168.50.100:18084` |
The BGE-M3 cache is reused from the retired unRaid Hindsight stack. The GTE
reranker has a separate cache. Both services use physical GPU0 and conservative
TEI concurrency/tokenizer settings.
reranker has a separate cache. Both services use physical GPU0 and the defaults
provided by the pinned TEI 1.9 image.
Hindsight uses the local embedding directly. Hindsight has no native embedding
provider fallback chain, so OpenRouter BGE-M3 remains a manual rollback rather
@@ -9,17 +9,6 @@ services:
- BAAI/bge-m3
- --dtype
- float16
- --max-input-length
- "8192"
- --max-client-batch-size
- "32"
- --max-concurrent-requests
- "64"
- --max-batch-tokens
- "8192"
- --tokenization-workers
- "4"
- --auto-truncate
environment:
HF_HUB_CACHE: /data
TZ: America/Los_Angeles
@@ -55,17 +44,6 @@ services:
- Alibaba-NLP/gte-multilingual-reranker-base
- --dtype
- float16
- --max-input-length
- "8192"
- --max-client-batch-size
- "32"
- --max-concurrent-requests
- "32"
- --max-batch-tokens
- "8192"
- --tokenization-workers
- "4"
- --auto-truncate
environment:
HF_HUB_CACHE: /data
TZ: America/Los_Angeles