Skip to content

server: Don't consider models with --no-mmproj-auto as multimodal - #25590

Merged
ngxson merged 1 commit into
ggml-org:masterfrom
sdroege:server-no-mmproj-auto
Jul 12, 2026
Merged

ngxson merged 1 commit into
ggml-org:masterfrom
sdroege:server-no-mmproj-auto

Conversation

@sdroege

@sdroege sdroege commented Jul 12, 2026

Copy link
Copy Markdown
Contributor

Overview

If mmproj is explicitly disabled via the model preset or command-line parameters then the model won't be able to handle image/audio inputs and this shouldn't be declared as supported input modality on the /v1/models endpoint.

Requirements

  • I have read and agree with the contributing guidelines
  • AI usage disclosure: YES. To understand the mapping of preset/command-line parameters.

If mmproj is explicitly disabled via the model preset or command-line
parameters then the model won't be able to handle image/audio inputs and
this shouldn't be declared as supported input modality on the /v1/models
endpoint.
@sdroege
sdroege requested a review from a team as a code owner July 12, 2026 15:46
@ngxson
ngxson merged commit 8014d2c into ggml-org:master Jul 12, 2026
23 of 25 checks passed
satindergrewal pushed a commit to satindergrewal/llama.cpp that referenced this pull request Aug 12, 2026
…ml-org#25590)

If mmproj is explicitly disabled via the model preset or command-line
parameters then the model won't be able to handle image/audio inputs and
this shouldn't be declared as supported input modality on the /v1/models
endpoint.
zbrad pushed a commit to zbrad/llama.cpp that referenced this pull request Sep 10, 2026
…ml-org#25590)

If mmproj is explicitly disabled via the model preset or command-line
parameters then the model won't be able to handle image/audio inputs and
this shouldn't be declared as supported input modality on the /v1/models
endpoint.
pl752 pushed a commit to pl752/llama.cpp that referenced this pull request Sep 15, 2026
…ml-org#25590)

If mmproj is explicitly disabled via the model preset or command-line
parameters then the model won't be able to handle image/audio inputs and
this shouldn't be declared as supported input modality on the /v1/models
endpoint.
frostyautumnleaf pushed a commit to frostyautumnleaf/llama.cpp that referenced this pull request Oct 5, 2026
…ml-org#25590)

If mmproj is explicitly disabled via the model preset or command-line
parameters then the model won't be able to handle image/audio inputs and
this shouldn't be declared as supported input modality on the /v1/models
endpoint.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants