Skip to content

fix(llama-cpp): Set enable_thinking in the correct place#8973

Merged
mudler merged 1 commit intomudler:masterfrom
richiejp:fix/llama-cpp-disable-thinking
Mar 12, 2026
Merged

fix(llama-cpp): Set enable_thinking in the correct place#8973
mudler merged 1 commit intomudler:masterfrom
richiejp:fix/llama-cpp-disable-thinking

Conversation

@richiejp
Copy link
Copy Markdown
Collaborator

Description

Allows thinking to be properly disabled when using Jinja templates

Notes for Reviewers

We were setting enable_thinking in the wrong map. It should be part of chat_template_kwargs

Signed commits

  • Yes, I signed my commits.

Signed-off-by: Richard Palethorpe <io@richiejp.com>
@netlify
Copy link
Copy Markdown

netlify bot commented Mar 12, 2026

Deploy Preview for localai ready!

Name Link
🔨 Latest commit be3e342
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/69b288f352248a0008901564
😎 Deploy Preview https://deploy-preview-8973--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Copy link
Copy Markdown
Owner

@mudler mudler left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ouch, good catch!

@mudler mudler merged commit b24ca51 into mudler:master Mar 12, 2026
41 checks passed
@mudler mudler added the bug Something isn't working label Mar 14, 2026
localai-bot pushed a commit to localai-bot/LocalAI that referenced this pull request Mar 18, 2026
Signed-off-by: Richard Palethorpe <io@richiejp.com>
Signed-off-by: localai-bot <localai-bot@users.noreply.github.com>
localai-bot pushed a commit to localai-bot/LocalAI that referenced this pull request Mar 25, 2026
Signed-off-by: Richard Palethorpe <io@richiejp.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants