Skip to content

Please add a configuration option to enable Think by default for some reasoning tasks. #913

Description

@lchyn

For some reasoning models, the Think process is required by default, but sometimes it is not necessary, and a quick response to the question is sufficient;
When making a request, parameters such as “thinking”: { “type”: “enabled” }, need to be added to the ChatComplete API request header to ensure it is turned on or off;
If using the OPENAI Response API, it would be in the form of reasoning={“effort”: “medium”}, etc.;
It is hoped that for large reasoning models like OPENAI, GLM, etc., which optionally support enabling the THINK mode, this parameter can be configured.
Allow users to turn on or off the think/reasoning option or set the level of thinking in the configuration interface for the deployed reasoning service.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions