Repository navigation
ui : add the models manager - #29583
Merged
Merged
Conversation
allozaur
added this pull request to stack #29589
September 28, 2026 14:47
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
September 28, 2026 14:48
4bc9615 to
6226aae
Compare
allozaur
removed this pull request from stack #29589
September 28, 2026 15:21
allozaur
added this pull request to stack #29594
September 28, 2026 15:24
allozaur
removed this pull request from stack #29594
September 29, 2026 04:55
allozaur
added this pull request to stack #29630
September 29, 2026 04:56
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
September 29, 2026 08:45
6226aae to
dde5615
Compare
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
September 29, 2026 10:05
dde5615 to
07fa3c0
Compare
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
September 29, 2026 10:27
07fa3c0 to
67e3f55
Compare
allozaur
removed this pull request from stack #29630
September 29, 2026 10:42
allozaur
added this pull request to stack #29646
September 29, 2026 10:43
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
September 29, 2026 12:02
67e3f55 to
df80072
Compare
allozaur
removed this pull request from stack #29646
September 29, 2026 12:14
allozaur
added this pull request to stack #29653
September 29, 2026 12:15
allozaur
commented
Sep 30, 2026
allozaur
left a comment
Contributor
Author
There was a problem hiding this comment.
Besides the comments for the files, there's one regression vs what we used to have some time ago — i can't see the draft sidecar badges in the model id in models selector and models manager
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
September 30, 2026 14:04
df80072 to
ea612b4
Compare
allozaur
removed this pull request from stack #29653
September 30, 2026 14:09
allozaur
changed the base branch from
allozaur/ui/shared-model-display
to
master
September 30, 2026 14:09
allozaur
added this pull request to stack #29748
September 30, 2026 14:12
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
October 1, 2026 06:39
ea612b4 to
7e26a5d
Compare
allozaur
removed this pull request from stack #29748
October 1, 2026 06:41
allozaur
added this pull request to stack #29790
October 1, 2026 07:42
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
October 5, 2026 12:22
e306eca to
93f884d
Compare
mishig25
approved these changes
Oct 5, 2026
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
3 times, most recently
from
October 6, 2026 16:18
4ca5a6e to
162dc8f
Compare
allozaur
removed this pull request from stack #29790
October 6, 2026 16:33
allozaur
added this pull request to stack #30055
October 6, 2026 16:33
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
3 times, most recently
from
October 8, 2026 12:56
dc83a2d to
6d4595d
Compare
allozaur
commented
Oct 8, 2026
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
October 9, 2026 06:17
6d4595d to
b7f40a7
Compare
Add the drawer and sheet overlay components, the toggle and toggle group, the shared searchable input, the collapsible sections and the grouped list, and the near viewport helper they position with. Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
Add the model row pieces shared by the selector and the manager, the models store with its download status feed, the huggingface and migration services, and the model utils, enums and constants they read through. Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
Group the selector components under their own folder, rework the list around the provider grouping, add the mobile trigger and the download item, and derive the selection state in one hook. Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
Add the manager table with its repo, quant and status rows, the filters and the toolbar, the row actions in a drawer, the downloads section, the manage models dialog and the stories and tests. Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
Move the add actions into a drawer and a sheet, float the model actions in a bar on a phone, open the context panel in a drawer, and derive the attachment, reasoning and tools menus in hooks. Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
Move the mcp servers dialog to the sidebar rail with its menu entries, even out the dialogs on a phone, and group the mcp and settings stores behind their own modules. Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
The secondary button gets its own look back and the chat add button its own light surface. Pressable elements get a pointer cursor again, the font rendering smooths on the app shell, and the agent skills stay out of prettier's way. The root layout props probe rework that came with this polish reads the providers api url and stays with the providers change instead. Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
Start a new chat selected the model but left it unloaded, so the chat opened against a server with nothing in memory. Both CTAs share a load helper now. Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
allozaur
force-pushed
the
allozaur/ui/models-manager
branch
from
October 9, 2026 08:12
b7f40a7 to
5e4f00a
Compare
ServeurpersoCom
approved these changes
Oct 9, 2026
feal87
added a commit
to feal87/myllama.cpp
that referenced
this pull request
Oct 9, 2026
Upstream brings the chat API refactor into common_chat_session (PR ggml-org#30210), the UI models manager (ggml-org#29583), server default port 9931 (ggml-org#30159), and CUDA / metal / sycl / vulkan / musa fixes. Conflicts and resolution: - server-context.cpp: upstream moved message spans into task.apply_chat_session() and dropped the per-request message_delimiters JSON round-trip. Keep the fork deferred-mtmd loop bound (n_inputs) and pass chat_session.message_delimiters() to task.mtmd_delims. - server-queue.cpp: keep the fork reported_tool_names / base_tool_names / markdown_fences bookkeeping and adapt it to upstream's task_result_state() free constructor. Kept the fork MoE expert cache (src/llama-moecache.*); scripts/fork-post-merge.sh reports no upstream MoE cache leftovers. Assisted-by: pi (deepseek-flash)
jiangchuanso
added a commit
to jiangchuanso/llama.cpp-zh-el8
that referenced
this pull request
Oct 10, 2026
上游 models manager 的两次重构(ggml-org#29583 与 ggml-org#30228)换掉了一批源文本,中文因此静默回退英文:删掉 19 条已无对应源文本的词条(旧模型信息表、旧模型选择器/移动端 sheet、旧附件菜单描述等),并把 3 条改名的补上。 用脚本核对:所有 t('X') 的键都有词条、没有失效词条、没有「原本有 t() 却变回裸字面量」的回归。
jiangchuanso
added a commit
to jiangchuanso/llama.cpp-zh-el8
that referenced
this pull request
Oct 10, 2026
上游 models manager(ggml-org#29583/ggml-org#30228)整块新界面此前保持英文,现补上:表格(表头/排序提示/空表/族计数/展开更多)、筛选器(上下文档位、能力与模态开关)、行操作(删除、隐藏、下载暂停/继续,统一在 DropdownMenuActions 这个唯一渲染点接 t())、模型配置面板(状态、加载/卸载/新建对话、删除、详情关闭)、选择器(管理模型、暂停/取消下载、返回全部提供方),以及模型管理对话框、下载确认对话框、markdown 图片失败兜底、推理 token 预算与 3 条设置项。 顺带修好两处结构:DialogConfirmDownload 的说明改用 {name} 占位符走 t();image-error-fallback 的 HTML 兜底串也接上 t()。 核对:所有 t('X') 的键都有词条、无失效词条、无重复键;zh-CN.ts 括号配平;改动的 svelte/ts 无新增诊断(只剩上游既有的 tailwind 类名建议)。
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
Demo
Screen.Recording.2026-10-09.at.10.13.23.mp4
Screen.Recording.2026-10-09.at.10.15.33.mp4
Features
ModelsSelector): owns the shared picker state and renders the desktop dropdown and the phone drawer as equal surfaces — provider-aware grouping, favorites and loaded pinned on top (listed once), hidden models filtered out, windowed lists with show more, provider mark + org avatar in the trigger; falls back to the manager on single-model servers, and a phone with one model still gets the drawer.Architecture / logic
modelsStorecomposes list, selection, loading, recents (manual picks only), favorites, hidden and group-open state, all persisted to localStorage; status store feeds download progress (and the delete-from-disk action resolves through its cancel endpoint).useChatFormModel; both surfaces and the assistant-message badge share it.vaul-svelte, toggles, collapsible sections, grouped list, near-viewport helper).ModelOptionenriched withcontextLength,draftSidecars(from--model-draftargs) and chat-template-based capability fallback; family grouping, list windowing and manager helpers (groupModelFamilies,groupModelQuants,splitHiddenQuants,hasActiveFilters,statusRank) live in tested utils.tools/ui/README.mddocuments the new structure and the drawer dependency.Requirements
pi:llama.cpp/DeepSeek-V4.1-Flash/pi:zai-org/GLM-5.3-Flash