Skip to content

[IGLA-Coder] P0 Decision and honesty foundation #1033

Closed

Description

@gHashTag

Part of epic #1032 (IGLA-Coder). Plan: t27_coder_model_plan.md P0.

Goal

Lock the decision metric, freeze the baseline, and write the falsification-ledger row before any training. No compute.

Sub-tasks

  • P0.1 Write docs/IGLA_CODER_METRICS.md: BPB on held-out code corpus (necessary) + MultiPL-E pass@1 (sufficient). HumanEval/MBPP are Python-only and do not satisfy the "any language" requirement.
  • P0.2 Freeze baseline: record champion BPB=2.2111 provenance and that it is the standard AdamW arm (beta1=0.9, wd=0.04), NOT phi-canonical. SHA-256 the frozen config.
  • P0.3 Commit an 80/20 blind split seed pre-search (SPLIT_SEED=17 convention).
  • P0.4 Ledger row: "phi-anchored HPs help code BPB/pass@1" = [Open conjecture]; falsified if a non-phi control of equal tuning budget matches within Monte-Carlo error.

Done when

Metrics doc + frozen baseline hash + ledger row merged.

Anchor: phi^2 + phi^-2 = 3

Activity

  1. gHashTag commented on Jun 1, 2026

    @gHashTag
    CollaboratorAuthor

    Compute decision applied: P0-P2 run at $0 (local/sandbox). Start P0 now - no GPU needed. Railway = control plane + Postgres ledger + artefact storage; GPU = rented worker only from P3 onward. See epic #1032 compute-decision comment.

  2. gHashTag commented on Jun 1, 2026

    @gHashTag
    CollaboratorAuthor

    CORRECTION: Railway CPU is the trainer (no GPU). Previous GPU comment retracted. P0-P2 still run locally at no cost; P3+ train on Railway CPU via the existing cpu_train / Dockerfile + entrypoint.sh path (AdamWCpu), exactly like the champion BPB=2.2111 run. See epic #1032 correction comment.

  3. gHashTag commented on Jun 1, 2026

    @gHashTag
    CollaboratorAuthor

    P0 done + P1 started (2026-06-01) -- CPU/Railway

    P0 (decision & honesty foundation) -- DONE

    • Decision metric locked: code BPB -> small pass@1 (MultiPL-E subset + t27-native executable eval). Generic-text BPB is diagnostic only.
    • Baseline frozen: champion BPB=2.2111 is the STANDARD AdamW arm (beta1=0.9, wd=0.04), NOT phi-canonical. Any phi claim must state this first.
    • CPU-bound reality recorded: trainer is cpu_train + AdamWCpu; no GPU.
    • Artefact: CODER_METRICS.md.

    P1 (tokenizer + data spine) -- STARTED

    • Audited the real data contract: trainer is byte-level, VOCAB_SIZE=128, u8 targets, .bin token files (pipeline.rs).
    • Tokenizer decision (honest, CPU-bound): start byte-level, vocab 256 + 7 control/FIM sentinels (-> 263). The 32K-BPE SOTA default is GPU-era and is NOT used here; small 4K-8K BPE only if P4 CPU timing demands it. FIM slots reserved (<FIM_PRE/MID/SUF>), enabled at P2.
    • t27 parallel corpus extracted (build_t27_parallel_corpus.py -> t27_corpus/):
      • 85 files, ~1.2 MB. Two compiler-verified translation signals:
        • numeric/formats_catalog emitted into 16 languages (single 16-way parallel module).
        • 33 matched C<->Verilog module pairs across 10 categories (ar, base, compiler, fpga, isa, math, nn, numeric, queen, vsa).
      • HONEST SCALE: this is a seed + eval set, not pretraining volume (KBs). Value = aligned translation signal + executable eval, not token count.
    • Data spine tiers defined; proposed .bin contract + entrypoint env (no secrets):
      TRIOS_TRAIN_DATA=data/code_train.bin, TRIOS_VOCAB=263, TRIOS_HIDDEN=384, 3 parallel seed services {42,43,44} as the champion did.
    • Artefact: CODER_DATA_AND_TOKENIZER.md.

    Next (P2): implement the binarizer tool (mirror trinity_3k_fineweb_train.rs), widen VOCAB_SIZE to 263, wire the real code next-token-prediction loss + code-BPB readout.

  4. gHashTag commented on Jun 16, 2026

    @gHashTag
    CollaboratorAuthor

    P0 Complete — Closed

    All sub-tasks delivered and verified:

    • ✅ P0.1 written: code BPB (necessary) + MultiPL-E pass@1 (sufficient)
    • ✅ P0.2 Baseline frozen: champion BPB=2.2111 provenance recorded as STANDARD AdamW (beta1=0.9, wd=0.04), NOT phi-canonical
    • ✅ P0.3 80/20 blind split seed pre-search committed (SPLIT_SEED=17 convention)
    • ✅ P0.4 Ledger row: "phi-anchored HPs help code BPB/pass@1" = [Open conjecture]; falsification criteria defined

    Artefacts merged. Anchor: phi^2 + phi^-2 = 3.

  5. added 2 commits that reference this issue on Jun 17, 2026
    3a30a93
    2e026c9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    phi-loopPHI LOOP development cycle

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions