Skip to content

Embed the engine into Lemonade, not Lemonade into the engine: drop the vendored Lemonade - #22

Merged
bong-water-water-bong merged 1 commit into
mainfrom
drop-embedded-lemonade
Sep 23, 2026
Merged

bong-water-water-bong merged 1 commit into
mainfrom
drop-embedded-lemonade

Conversation

@bong-water-water-bong

Copy link
Copy Markdown
Collaborator

Stacked on #21 (1bit serve). This follows geramyL's review: the engine is a backend Lemonade launches and exposes only an OpenAI-compatible API.

Removed

  • third_party/lemonade: Lemonade v11.9.0, about 900 files, plus our local deltas (the onebit, mlx and zinc recipes, hrx_device, the embed patch).
  • 1bit lemonade, and the Lemonade-specific tests: smoke_lemonade and the hrx, zinc and mlx lemonade e2e tests.
  • 1bit now builds in 3 steps instead of about 290.

Kept, or moved into 1bit serve

  • All devices: NPU, Vulkan, HRX and ZINC, plus the new --device mlx for Apple Silicon. It uses the old mlx recipe's launch contract, so MLX isn't lost.
  • Dependencies: json v3.11.3 and cpp-httplib v0.47.0 are now pinned by the engine itself, at the same commits as before.
  • Portable child handling: PR_SET_PDEATHSIG on Linux and posix_spawnp elsewhere, so the engine still builds on macOS.

New

tests/smoke_serve.sh + tests/fake_backend.py test serve's proxy in CI, without a GPU: health, models, the reply rename, SSE relay, and no orphaned backend after SIGKILL.

Docs

lemonade.md now describes the new relationship and how it got here. Also updated: serve, apple, hrx, npu, zinc and kernel docs, PORTING step 1 and its diagram, the README intro, status and thank-you (Lemonade is thanked as the engine's home), NOTICE (Lemonade and its fetched libraries removed; json and httplib listed as ours), and bump-hrx.yml.

Verified

  • ryzen (no NPU): builds; ctest passes (smoke_serve, npu_full_elf_md5).
  • Strix Halo NPU build: builds; ctest passes; serve_e2e passes on npu, vulkan, hrx and zinc.
  • Not rerun: --device mlx on the Mac. The launch contract is unchanged from the verified recipe; ctest serve_e2e_mlx is ready for it.

Next: the upstream Lemonade recipe PR that launches 1bit serve. It goes to AMD's repo, so the draft comes to you first.

🤖 Generated with Claude Code

Base automatically changed from serve to main September 23, 2026 22:40
…e vendored Lemonade

Following geramyL's review. The engine is a backend Lemonade launches; it
exposes only an OpenAI-compatible API (1bit serve).

- third_party/lemonade (v11.9.0, ~900 files) and its local deltas (onebit,
  mlx and zinc recipes, hrx_device, embed patch) are removed, as are
  `1bit lemonade` and its Lemonade-specific tests. `1bit` now builds from 3
  steps instead of ~290.
- json v3.11.3 and cpp-httplib v0.47.0 are pinned by the engine itself (the
  same commits as before).
- 1bit serve --device mlx keeps MLX on Apple Silicon (the former local mlx
  recipe's launch contract: lemon-mlx-server <hf id> --port).
- Portable child spawn: fork + PR_SET_PDEATHSIG on Linux, posix_spawnp
  elsewhere; model ids keep dots except a .gguf extension.
- tests/smoke_serve.sh + tests/fake_backend.py: serve's proxy in CI without a
  GPU (health, models, rename, SSE relay, no orphan after SIGKILL).
- Docs: lemonade.md (the new relationship and how it got here), serve.md,
  apple.md, hrx.md, npu.md, zinc.md, kernel.md, PORTING step 1 and diagram,
  README intro/status/thank-you, NOTICE (Lemonade and its fetched libraries
  removed; json and httplib now fetched by us), bump-hrx.yml.

Verified: ryzen (no NPU) builds and ctest passes (smoke_serve,
npu_full_elf_md5); Strix Halo NPU build: ctest passes and serve_e2e passes
on npu, vulkan, hrx and zinc.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@bong-water-water-bong
bong-water-water-bong enabled auto-merge (squash) September 23, 2026 22:53
@bong-water-water-bong
bong-water-water-bong merged commit 216b1ac into main Sep 23, 2026
1 check passed
@bong-water-water-bong
bong-water-water-bong deleted the drop-embedded-lemonade branch September 23, 2026 22:54
bong-water-water-bong added a commit that referenced this pull request Sep 26, 2026
…, ZAYA1-8B decode 25.5 -> 47.9 tok/s on HRX (llama.cpp #22, #24) (#168)

Co-authored-by: bong-water-water-bong <bong-water-water-bong@1bit.gg>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant