Handle extended thinking with Anthropic provider, process streaming thinking blocks and show them in the output tab

[ferenci84]

Description

This modification allows users to see the human-readable parts of the thinking blocks in the LLM output.

This simple change is a first step on the way of full implementation of handling thinking blocks.

Checklist

• The relevant docs, if any, have been updated or created
• The relevant tests, if any, have been updated or created

Screenshots

[ For visual changes, include screenshots. ]

Testing instructions

Thinking can be enabled in config this way:

   {
      "title": "Anthropic - Claude 3.7 Sonnet (thinking)",
      "model": "claude-3-7-sonnet-latest",
      "provider": "anthropic",
      "apiKey": "xxx",
      "completionOptions": {
        "temperature": 1,
        "topP": 0.999,
        "maxTokens": 8096
      },
      "requestOptions": {
        "extraBodyProperties": {
          "thinking": {
            "type": "enabled",
            "budget_tokens": 2048
          }
        }
      },
      "cacheBehavior": {
        "cacheConversation": true,
        "cacheSystemMessage": true
      }
    },

Watch the Continue - LLM Prompt/Completion output tab.

Next steps

1. The thinking mode doesn't currently work with tool use. The software should add the thinking and redacted_thinking blocks to the conversation history when sending subsequent requests. Tool use requires this, with no tool use, any thinking blocks will be ignored.

2. human-readable thinking blocks could be added to the UI in form of collapsible boxes. This is an example from TypingMind:

Edit

Handling thinking blocks and redacted_thinking blocks have been added. Due to these changes, these thinking blocks have also became visible. This may require some visual update, but it's now accessible and functional, and we are closer to a final solution where users can read the thinking blocks if they want.

Additional testing instructions

The changes are working if you can call tools with no problem.

Redacted thinking can be tested by adding this string in your first prompt:
ANTHROPIC_MAGIC_STRING_TRIGGER_REDACTED_THINKING_46C9A13E193C177646C7398A98432ECCCE4C1253D5E2D82641AC0E52CC2876CB

Edit 2

I have added rendering of thinking blocks as shown in the screenshots below:

[netlify]

✅ Deploy Preview for continuedev canceled.

Name	Link
🔨 Latest commit	93602e3
🔍 Latest deploy log	https://app.netlify.com/sites/continuedev/deploys/67c82a7750307300085b89a2

[chezsmithy]

Would it be possible to add the same support to Bedrock.ts now that I have enabled tools support, and have a seprate PR to enable claude 3.7 on bedrock as well?

[ferenci84]

Would it be possible to add the same support to Bedrock.ts now that I have enabled tools support, and have a seprate PR to enable claude 3.7 on bedrock as well?

@chezsmithy I have just sent a PR that does the same with Bedrock: #4444

[Symfomany]

Deep Research would be a killer-feature in this coding assistant Continue, it's possible to have Perplexity API Key too ?

[ferenci84]

@RomneyDa You are the assignee of issue #4339 and this PR would resolve it, can you please review?