Skip to content

server : improve startup log messages - #29125

Merged
ggerganov merged 2 commits into
masterfrom
gg/server-improve-ux
Sep 19, 2026
Merged

ggerganov merged 2 commits into
masterfrom
gg/server-improve-ux

Conversation

@ggerganov

Copy link
Copy Markdown
Member

Overview

  • Show \[source\] tag (cached/models/preset) per model in the "Available models" log instead of the cryptic \* marker
  • Degrade "Loaded X model presets from ..." lines to trace level
  • Print a hint to visit https://llama.app/models when no models are found
  • Simplify CORS and feature warnings to single-line messages
  • Add hf_cache::get_cache_path() public accessor
  • Add "initializing ..." log line

Requirements

@ggerganov
ggerganov marked this pull request as ready for review September 19, 2026 10:14
@ggerganov
ggerganov requested review from a team as code owners September 19, 2026 10:14

@ServeurpersoCom ServeurpersoCom left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, the only API change is the /models source value (cache -> cached, models_dir -> models), and llama-ui doesn't read it.

@nikwen nikwen left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Would be great to document the API change in #9291.

@ggerganov

ggerganov commented Sep 19, 2026 •

Copy link
Copy Markdown
Member Author

Hm, there is no API change - WDYM?

Edit: nvm, I didn't realized that these strings are also used in the API

- Show [source] tag (preset/models_dir/cache) per model instead of cryptic * marker
- Show HF hub cache path in the 'Loaded cached model presets' log
- Add hf_cache::get_cache_dir() public accessor

Assisted-by: pi:llama.cpp/Qwen3.8-27B

@ServeurpersoCom ServeurpersoCom left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The /models API is now unchanged

@ggerganov
ggerganov merged commit 1af554f into master Sep 19, 2026
12 checks passed
@ggerganov
ggerganov deleted the gg/server-improve-ux branch September 19, 2026 12:37
ggerganov pushed a commit that referenced this pull request Sep 23, 2026
Restore get_cache_directory() as fs::path as string() can be lossy on Windows

Partially reverts #29125

Signed-off-by: Adrien Gallouët <angt@huggingface.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants