Skip to content

Conversation

@majiayu000
Copy link

Fixes #329

Changes

  • Added thinking field (boolean) to enable thinking mode for reasoning models
  • Added thinking_budget_tokens field to configure max tokens for thinking output
  • Updated both docker-compose and helm-chart model_config.yaml files

Add thinking switch configuration for Docker and Helm deployed services:
- thinking: boolean to enable thinking mode
- thinking_budget_tokens: max tokens for thinking output

Signed-off-by: majiayu000 <1835304752@qq.com>
@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

1 similar comment
@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

The example model_config.yaml does not have a thinking field.

2 participants