Skip to content

Build option for private HIP kernels on HRX (-DONEBIT_GPU_PRIVATE) - #307

Merged
bong-water-water-bong merged 1 commit into
mainfrom
1bit/gpu-private-hook
Oct 5, 2026
Merged

bong-water-water-bong merged 1 commit into
mainfrom
1bit/gpu-private-hook

Conversation

@bong-water-water-bong

Copy link
Copy Markdown
Collaborator

Stacked on #306. Draft: do not merge yet. The release is on hold.

-DONEBIT_GPU_PRIVATE=<checkout> builds a private HIP kernel add-on into the HRX llama.cpp build. It passes GGML_HRX_HIP_ADDON_DIR=<checkout>/addons/hip-hrx to the llama_hrx ExternalProject. This mirrors -DONEBIT_NPU_PRIVATE.

  • The option requires ONEBIT_HRX=ON, and configure fails clearly without it.
  • It also requires a llama.cpp pin that has the add-on hook: 1bit-MONSTER/llama.cpp#86. Until the pin moves there, setting the option fails at configure with a clear message.
  • The default build is unchanged: ctest 17/17 on ryzen.
  • docs/hrx.md has a short "Private HIP kernels" section.

🤖 Generated with Claude Code

@context7

context7 Bot commented Oct 5, 2026 •

Copy link
Copy Markdown

Docs7 for 1bit-monster/engine

Result Status Action
Deployment ➖ Not used —
Content review ➖ Did not run. This site has no agent runs available this month. Wait for the monthly reset or check your Docs7 plan. —

Commit ce7620f

Base automatically changed from 1bit/core-strip to main October 5, 2026 11:20
@bong-water-water-bong
bong-water-water-bong marked this pull request as ready for review October 5, 2026 11:21
@bong-water-water-bong
bong-water-water-bong enabled auto-merge (squash) October 5, 2026 11:21
ONEBIT_GPU_PRIVATE=<gpu-kernels checkout> (needs ONEBIT_HRX) forwards
GGML_HRX_HIP_ADDON_DIR=<checkout>/addons/hip-hrx to the HRX llama.cpp
external project, which compiles that add-on's kernels and matchers into
ggml-hrx. Configure fails if the checkout has no addons/hip-hrx/kernels
or the llama.cpp pin has no GGML_HRX_HIP_ADDON_DIR hook. Without the
option nothing changes. docs/hrx.md: "Private HIP kernels".

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@bong-water-water-bong
bong-water-water-bong merged commit 335f0c6 into main Oct 5, 2026
7 of 8 checks passed
@bong-water-water-bong
bong-water-water-bong deleted the 1bit/gpu-private-hook branch October 5, 2026 11:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant