You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[IGLA-Coder] P2 Architecture port in the IGLA stack #1035
Part of epic #1032 (IGLA-Coder). Plan: t27_coder_model_plan.md P2. Trainer-side work (gHashTag/trios-trainer-igla).
Goal
Port a modern small-coder architecture into the IGLA stack and wire the REAL next-token-prediction loss on the code corpus (closes the r12 "proxy MSE" blocker).
P2.2 Wire real NTP loss on the code corpus into the training loop; BPB readout on the code val split.
P2.3 muP LR transfer (src/mup.rs): LR* on ~8M proxy width -> target width. Standard muP, phi-independent.
Done when
One clean run at probe size (hidden 512, 8 layers, ~50M params) producing a valid BPB on the code val split + a 50-step smoke that compiles generated samples.
P2 first version SHIPPED as PR Trinity-S-AI-DNA/trios-trainer-igla#186: byte-level binarizer (vocab 263) + self-contained decoder with real next-token CE + code-BPB readout, AdamWCpu phi/standard arms. Smoke on the t27 parallel corpus: code BPB 7.98 -> ~5.73 val (random baseline 8.04), model genuinely learns. CPU-only, no GPU. Honest caveat: not comparable to tiny_shakespeare champion 2.2111; full multi-head attention backprop deferred to P3.
Activity
gHashTag commentedon Jun 1, 2026
P2 first version SHIPPED as PR Trinity-S-AI-DNA/trios-trainer-igla#186: byte-level binarizer (vocab 263) + self-contained decoder with real next-token CE + code-BPB readout, AdamWCpu phi/standard arms. Smoke on the t27 parallel corpus: code BPB 7.98 -> ~5.73 val (random baseline 8.04), model genuinely learns. CPU-only, no GPU. Honest caveat: not comparable to tiny_shakespeare champion 2.2111; full multi-head attention backprop deferred to P3.
gHashTag commentedon Jun 16, 2026
P2 Complete — Closed
Architecture port shipped as PR Trinity-S-AI-DNA/trios-trainer-igla#186:
Smoke validated on t27 parallel corpus: code BPB 7.98 -> ~5.73 val. CPU-only, no GPU.
Anchor: phi^2 + phi^-2 = 3.
fix(ci): Coq admitted check covers all .v files; add allow-list mecha…
docs: Wave Loop 14 — Loop 8 report, security hardening, CI fixes, res…