Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions docs/hrx.md
Original file line number Diff line number Diff line change
Expand Up @@ -172,13 +172,13 @@ were observed.
under the profiler fails.
- **ZAYA decode fusions (llama.cpp #36-#40).** ZAYA1-8B HRX0 decode 67 -> ~90 tok/s (Vulkan 93),
each step measured in interleaved A/B runs:
- #36 skips CONTs of fresh contiguous results in `src/models/zaya.cpp` (views keep theirs: on HRX
- PR #36 skips CONTs of fresh contiguous results in `src/models/zaya.cpp` (views keep theirs: on HRX
their consumers take slower strided paths), bitwise the same output: +2.4%.
- #39 runs the CCA convolution (Q/K concat, conv-state update, depthwise conv, grouped 2-tap conv
- PR #39 runs the CCA convolution (Q/K concat, conv-state update, depthwise conv, grouped 2-tap conv
and biases, ~35 graph nodes) as one dispatch (`zaya.cca_conv.decode_f32`): 72 -> 81 tok/s.
- #40 runs the CCA query/key mixing and per-head norms (~30 nodes) as one dispatch
- PR #40 runs the CCA query/key mixing and per-head norms (~30 nodes) as one dispatch
(`zaya.cca_qk_norm.decode_f32`): 81 -> 90 tok/s.
#39 and #40 accumulate in their own order, so output is not bitwise the same; teacher-forced top-1
PRs #39 and #40 accumulate in their own order, so output is not bitwise the same; teacher-forced top-1
against the FP32 model stays 69/96 and batch-1 perplexity moves 33.31 -> 33.49 -> 33.45 (CPU backend
34.30). Both match decode only (one token, one sequence). #37 and #38 remove runtime integer
division from #35's and #32's kernels, which newer Loom rejects. Each new `.loom` file carries a
Expand Down
4 changes: 4 additions & 0 deletions tools/site.py
Original file line number Diff line number Diff line change
Expand Up @@ -358,6 +358,10 @@ def write(self, name, title, main, kind, section, description=TAGLINE, extra_hea
.replace("{{repo}}", REPO))
if extra_head:
page = page.replace("<head>", "<head>\n" + extra_head, 1)
# one h1 per page (SEO): a line starting "#36 ..." in a doc renders as a stray h1
h1 = len(re.findall(r"<h1[\s>]", page, re.I))
if h1 != 1:
sys.exit(f"{name}.html has {h1} <h1> elements; start no doc line with '#<number>'")
(self.out / f"{name}.html").write_text(page)

def md(self, text, src):
Expand Down
Loading