Repository navigation
ComfyUI.cpp inside the engine: 1bit comfy - #65
Conversation
third_party/comfyui.cpp (1bit-MONSTER/comfyui.cpp, GPL-3.0) is built as its own program by scripts/build-comfyui.sh (-DONEBIT_COMFYUI=ON); 1bit comfy execs it and never links it, so the engine stays Apache-2.0. SD1.5 txt2img through 1bit comfy on Strix Halo: 48 s, 50.6 dB PSNR against ComfyUI. docs/comfyui.md, NOTICE, README, site nav. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Docs7 for 1bit-monster/engine
Commit |
PR Reviewer Guide 🔍Here are some key observations to aid the review process:
|
…66) * 1bit comfy: run the checked file (fexecve), absolute ONEBIT_COMFYUI; fetch the submodule when missing PR-Agent review on #65: the binary is opened once, checked through the descriptor (regular, executable, not writable by others) and run with fexecve, so no swap between check and exec; ONEBIT_COMFYUI must be absolute and relative PATH entries are skipped. CMake and build-comfyui.sh fetch third_party/comfyui.cpp themselves when it is not initialised. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * 1bit comfy: say why the descriptor needs no close after fexecve Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> --------- Co-authored-by: bong-water-water-bong <bong-water-water-bong@1bit.gg> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
…5 -> 90.9), MXFP4 weights (#282) llama.cpp fork since d60cc4f: - #64: a kernel for the MUL_MAT ggml hints as GGML_HINT_SRC0_IS_HADAMARD. Bonsai's 1024-point rotation of the 17408-wide FFN input ran on the CPU in every layer at prompt sizes. Ternary-Bonsai-2-27B, balanced mode: pp512 13.5 -> 90.9 tok/s, tg128 15.8 -> 19.0. test-hrx-hadamard: six shapes vs CPU and an exact product, x4, bitwise-identical repeats; 8 sanitizer-clean check.cases. - #65: MXFP4 in the shared dequantizer, the E8M0 scale built exactly as GGML_E8M0_TO_FP32_HALF. test-hrx-mxfp4 bit-exact vs ggml on HRX0 (subnormal scales e = 0/1 flush to zero); test-backend-ops -b HRX0 1051/1051. MUL_MAT_ID admits only multiples of 256 (its kernels declare it): gpt-oss-20b's 2880-wide experts fall back to the CPU instead of failing the JIT. Docs: docs/hrx.md Ternary Bonsai section and "Our patches". Registry regenerated (no mapping changes). Co-authored-by: bong-water-water-bong <bong-water-water-bong@1bit.gg> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Brings ComfyUI.cpp into the engine.
third_party/comfyui.cppat4a08238(1bit-MONSTER/comfyui.cpp master, with the SD1.5 fixes and the ComfyUI pin).-DONEBIT_COMFYUI=ONrunsscripts/build-comfyui.sh, which buildsbuild/comfyui/comfyui_cppagainst LibTorch from Python'storch. It's off by default, and CI doesn't check out submodules, so CI is unaffected.1bit comfy <workflow.json>runs a ComfyUI API-format workflow. It looks for the binary in$ONEBIT_COMFYUIfirst, then this build's, thenPATH.Measured on strixhalo (separate build of this branch,
v1-5-pruned-emaonly):1bit comfyruns txt2img "a cat" (seed 0, 20 steps, 512×512) in 48 s on the CPU, at 50.6 dB PSNR against Python ComfyUI (pinned1568e6c). Image-to-image: 51.2 dB.Docs:
docs/comfyui.md(also in the site sidebar under Components), README feature list, NOTICE.🤖 Generated with Claude Code