Skip to content

feat(claw): P0 token-efficiency baseline from the existing harness session logs #12962

Closed

Description

@gHashTag

Refs #12951 (Matryoshka Token-Efficiency Program, phase P0 of its planned children), #12945 (T27 M epic), #12948 (phase 0 harness budgets, the source of the logs).

Boundary

In scope: a read-only baseline of tokens, time and outcome per model step, taken from the 10 existing session logs of the #12948 runs (56 steps, 56 usage records, one model, glm-5.3-flash through the provider t27-ladder); one file, docs/claw/token_efficiency_baseline.md, with at least 3 work classes (the task types of #12948); the named source and known error of every count (the restated item 4b of the P0 execution gate of #12951).

Out of scope: any change of routing, prompt or model; any new run of the harness; a cost in money (the log holds no price); trace ids and the 19-field spans of FR-014 of #12951 (they wait for #12948, U4); any speed, saving or quality claim; any key value, token or home path.

User Scenarios

  1. A reviewer opens the baseline and reads, per work class, the value, N, command, head and date of each row, and sees N before any number.
  2. Phase P1 (cost formulas) takes the baseline as its input and finds the source and its known error beside every count.
  3. The owner asks what a step costs today and reads one table that says n/a with a reason where the log has no figure, instead of a guess.
  4. A reader reruns the command of a row against the same logs and gets the same number.

Requirements

Success Criteria

Activity

  1. gHashTag commented on Oct 31, 2026

    @gHashTag
    CollaboratorAuthor

    Claim (tick 156, analog loop session, started 16:06 +07): P0 gate for this issue passed on two samples 64 s apart (1-min load 14.65 and 14.78, below 15; free disk 11.25 GiB, above 10; no prior partial file; harness pinned by #12948; no routing, prompt or model change). Starting the baseline file docs/claw/token_efficiency_baseline.md now, marker "reconciliation baseline; full span telemetry pending". Another tick or session that sees this: please take a different task.

    🤖 Addressed by Claude Code

  2. gHashTag commented on Oct 31, 2026

    @gHashTag
    CollaboratorAuthor

    Claim withdrawn (tick 156). The gate was open on two samples (16:05:16 and 16:06:20), but the 120 s write window of FR-007 lapsed at 16:08:20 before the file was started; 0 baseline files exist on master or any branch, and nothing was pushed. The task is free again for the next tick or any session: take a fresh pair of gate samples 60 s apart, have the 10 source numbers ready, then begin the write inside the window. Details are on #12951.

    🤖 Addressed by Claude Code

  3. gHashTag commented on Nov 17, 2026

    @gHashTag
    CollaboratorAuthor

    Spec created: specs/claw/token_efficiency.t27 (typecheck OK, 1 test passes).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions