Repository navigation
docs: make the first CPU decision reproducible - #89
Merged
Merged
Conversation
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
hsliuustc0106
marked this pull request as ready for review
October 5, 2026 04:54
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
The README's quickstart starts only the frontend and leaves users to assemble a worker recipe. Add one complete Linux CPU LAYA walkthrough, a matching Chinese entry page, pinned tested dependencies, readiness checks and a real refund-decision demo. Put the walkthrough, demo and support matrix at the README entry point, and reconcile the matrix with the merged Python MPS worker and CLM stub-encoder recipe.
Refs #86 and #83. This PR remains draft for an independent contributor's first-use reproduction; it does not close #86 or claim that agent testing satisfies that acceptance item. No serving/model implementation changes or launcher are added.
Test Plan
System1-Omni Version / Commit:
f594d7dfc4c2bef812e23f7ed73573be9625b287(fetched upstream main; runtime/model code unchanged).Reproduce the documented CPU worker/frontend path, check all three question types through direct and frontend requests, resolve CPU requirements, build the documentation site, check generated links/anchors, and compare the English/Chinese shell and response examples.
Test Result
cargo build -p omni-jev --release --locked: passed.laya-serveCPU worker plus frontend: worker/frontend health and the documented refund request returned 200, both with the reused environment/checkpoint and with a fresh environment and isolated empty Hub model cache. The fresh run used current model revision7b928d828b7b0e022f929d9bd2e44165aa270148and produced the same outputs.python3.12 recipe/compare_with_backend.py --model english --backend http://127.0.0.1:8000 --frontend http://127.0.0.1:8086: all five checks passed (health, choice, score, noul and combined), with equal body bytes.python3.12 -m venv .venv, CPU PyTorch installation andpip install -r recipe/laya/requirements-cpu.txtalso passed in a fresh task-local environment;pip checkfound no broken requirements.mkdocs build --strictwith the versions indocs/requirements.txt: passed.bash -n; local Markdown targets and rendered entry-page links/anchors resolve.git diff --check: passed.GitHub CI passed the Docs build, benchmark-harness tests and Rust job (format, Clippy, frontend API tests, workspace tests and release build). The full workspace checks were not repeated locally for this documentation-only change. GPU execution is inapplicable. No new CPU performance or accuracy measurements are claimed. The existing scoped H200 result is linked separately from this CPU walkthrough.
Demo / evidence
See
recipe/laya/validation.md,first-decision.jsonandfirst-decision-comparison.txtfor the real request, complete response, comparison stdout, host/toolchain/package versions, model revision and preparation boundaries. The cached demo uses the English checkpoint at55cf4c4ebb4ebe31b2550e8bdf3bd21b99753851, Python 3.12.13 and CPU-only PyTorch 2.8.0. The host is Ubuntu 22.04.5 / Xeon Platinum 8480C; no GPU work was performed. Frontend port 8086 avoided an existing service on 8080. The fresh-run package capture is inrecipe/laya/fresh-environment.txt; its five comparison outputs matched the cached transcript. Independent first-use reproduction remains pending. Video and new A/B performance measurements are N/A for this documentation change.Self-review
Agent self-review used the repository's
precheck-prskill: basef594d7dfc4c2bef812e23f7ed73573be9625b287, head2c3c595ac1918ee67df8c927088e00217701916c, clean working tree. The full documentation diff, technical scope, source support, examples and rendered links were checked. The contributor checklist remains for the contributor; this PR stays draft pending independent first-use evidence.