diff --git a/.env b/.env index 86a52e30132..7aee51a6cdf 100644 --- a/.env +++ b/.env @@ -48,6 +48,14 @@ MODELS= # to use for internal tasks (title summarization, etc). If not set, the current model will be used TASK_MODEL= +## Reasoning +# Reasoning-capable models stream their chain-of-thought. Set to "true" to also +# generate short, periodic natural-language summaries of that reasoning, shown as +# status updates while the model thinks. This issues additional LLM calls (using +# TASK_MODEL if set, otherwise the conversation model), so it is disabled by +# default. Leave empty/unset to disable. +REASONING_SUMMARY= + ## LLM Router Configuration # Path to routes policy (JSON array). Required when the router is enabled; must point to a valid JSON file. # The router uses heuristic-based selection to pick the best model for each request. diff --git a/docs/source/configuration/overview.md b/docs/source/configuration/overview.md index 64a0bed9056..efac37488da 100644 --- a/docs/source/configuration/overview.md +++ b/docs/source/configuration/overview.md @@ -55,6 +55,16 @@ TASK_MODEL=meta-llama/Llama-3.1-8B-Instruct If not set, the current conversation model is used. +## Reasoning + +Reasoning-capable models stream their chain-of-thought. To also generate short, periodic natural-language summaries of that reasoning (shown as status updates while the model thinks), enable: + +```ini +REASONING_SUMMARY=true +``` + +This issues additional LLM calls (using `TASK_MODEL` if set, otherwise the conversation model), so it is **disabled by default**. Leave it unset or empty to keep reasoning summaries off. + ## Voice Transcription Enable voice input with Whisper: