Skip to content

Retrain archetype brains: labels have drifted from their trained state #4111

Open

Description

@github-actions

The archetype brains have fallen out of step with the engine. Labels in DEGRADED levels are still emitted but qualified; INVALID levels are withheld (Unvalidated). This issue is opened, updated and closed by archetype-validation.yml (#4100) -- it closes itself once every level is back to VALIDATED or DRIFTING.

Current state

trained against engine v2.9.1 (44ffeb1, 2026-09-19); last measured at engine f81ab92 on language-crucible@v1.7.0

Level State Agreement Why
function DRIFTING 96.6% engine changes since training relabelled 3.4% of crucible files (agreement 96.6%)
file UNVALIDATED -- brain changed since the validation record was cut (fingerprint 104a9f96499b9010); note: 18/18 labels are unnamed cluster indices (e.g. 'file_cluster_0') -- reports show a cluster number, not an archetype
composition_file DEGRADED 96.4% engine changes since training relabelled 3.6% of crucible files (agreement 96.4%); composition_file inputs disagree with the function model's labels: never read ['Annotated & Test Methods', 'Stateful Encapsulated Methods'], never emitted ['Annotated Framework Methods', 'Tests & Verification'] -- those units drop out and those input columns are always 0.0
composition_repo INVALID (withheld) -- not measurable on one corpus; inherits composition_file's measured state; composition_repo reads the composition_file brain labels by name, but none of its 20 inputs (e.g. 'Static: Literature & Documentation') is a label the composition_file brain emits (e.g. 'Annotated Framework Methods Files') -- every input column is 0.0

Eroding archetypes (share of trained-state members still assigned):

  • function C Struct Operations: 95.1% retained
  • function Encapsulated Accessors: 85.6% retained
  • function I/O & Config Routines: 92.5% retained
  • function State Mutators: 93.4% retained
  • function Stateful Encapsulated Methods: 86.4% retained
  • file file_cluster_13: 97.4% retained, mostly to 'file_cluster_15'
  • file file_cluster_15: 97.9% retained, mostly to 'file_cluster_10'
  • file file_cluster_16: 55.6% retained, mostly to 'file_cluster_15'
  • file file_cluster_6: 94.5% retained, mostly to 'file_cluster_4'
  • file file_cluster_8: 81.6% retained, mostly to 'file_cluster_6'
  • file file_cluster_9: 92.3% retained, mostly to 'file_cluster_2'
  • composition_file Callbacks & Closures Files: 95.3% retained, mostly to 'Large Core Modules (2)'
  • composition_file Compute Cores Files: 95.4% retained, mostly to 'Large Core Modules (3)'
  • composition_file Encapsulated Accessors Files: 83.0% retained, mostly to 'Large Core Modules (2)'
  • composition_file Interface Declarations Files: 98.0% retained, mostly to 'Large Core Modules'
  • composition_file Large Core Modules: 92.1% retained, mostly to 'Interface Declarations Files'
  • composition_file Large Core Modules (3): 90.4% retained, mostly to 'Interface Declarations Files'
  • composition_file Many-Argument Workhorses Files: 90.0% retained, mostly to 'Large Core Modules (2)'
  • composition_file State Mutators Files: 93.5% retained, mostly to 'Parameter Forwarders Files'

Agreement = share of crucible code files labelled as at training; stability, not accuracy.

Clearing it

  1. Retrain/refreeze the brains in gitgalaxy-population-analyses on a current fleet scan.
  2. Land them here with the paired engine review (EXPECTED_CONTRACT_SHA in tests/core_engine/test_archetype_parity.py) and a golden-master re-bless.
  3. Re-anchor the drift baseline on the engine the brains were trained against:
    python tests/tools/archetype_drift.py rebaseline --audit <crucible audit> --engine-version vX.Y.Z --engine-commit <sha> --trained-at <date> --corpus <corpus>

Recent measurements

Date Engine function file composition_file composition_repo
2026-10-02 aaf0f7cb 98.6% VALIDATED 99.3% VALIDATED 97.8% DEGRADED INVALID
2026-10-02 575c3900 98.5% VALIDATED 98.8% VALIDATED 97.7% DEGRADED INVALID
2026-10-04 2d7052cc 98.4% VALIDATED 98.8% VALIDATED 97.4% DEGRADED INVALID
2026-10-05 49cba5db 98.4% VALIDATED 98.7% VALIDATED 97.4% DEGRADED INVALID
2026-10-19 f8462915 98.4% VALIDATED UNVALIDATED 97.2% DEGRADED INVALID
2026-10-20 c1432265 98.4% VALIDATED UNVALIDATED 97.1% DEGRADED INVALID
2026-10-24 c85b4481 98.0% VALIDATED UNVALIDATED 97.0% DEGRADED INVALID
2026-10-25 553e936d 98.0% VALIDATED UNVALIDATED 97.0% DEGRADED INVALID
2026-10-26 f81ab92c 96.6% DRIFTING UNVALIDATED 96.4% DEGRADED INVALID

Activity

  1. added
    data-integrityIssues relating to RAM state or SQLite database fidelity
    archetype-retrainArchetype brains have drifted from their trained state (#4100)
    on Oct 2, 2026
  2. squid-protocol commented on Oct 3, 2026

    @squid-protocol
    Owner

    Note for the next retrain: feature_flags is being retired (#4114, closed not-planned). In the same change as the retrain, remove it from SIGNAL_SCHEMA, SURFACE_FAMILIES['debt'], the arch_feature_flags column, log_density_arch_feature_flags in the file brain's feature list, and tests/signal_coverage_baseline.json, so the feature-dimension change rides on this retrain instead of forcing a second one.

  3. squid-protocol commented on Oct 18, 2026

    @squid-protocol
    Owner

    Waiting on an owner decision (asked privately, 2026-10-18). Nothing is needed from contributors; work resumes once it is answered.

  4. 7 remaining items

  5. squid-protocol commented on Oct 24, 2026

    @squid-protocol
    Owner

    Churn run 4111-20261024T0437Z (host nyx) ended without a PR. blocked: needs owner decision + retrain in population-analyses; not requeue

  6. squid-protocol commented on Oct 24, 2026

    @squid-protocol
    Owner

    Churn run 4111-20261024T1803Z (host melek) ended without a PR. no PR; blocked on owner decision + retrain in population-analyses; do not requeue

  7. squid-protocol commented on Oct 24, 2026

    @squid-protocol
    Owner

    Churn run 4111-20261024T1822Z (host nyx) ended without a PR. no PR; blocked on owner decision + retrain; do not requeue

  8. squid-protocol commented on Oct 25, 2026

    @squid-protocol
    Owner

    Churn run 4111-20261025T0855Z (host melek) ended without a PR. No code change; #4111 waits on owner decision + population-analyses retrain. Not requeued.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    archetype-retrainArchetype brains have drifted from their trained state (#4100)bugUnintended behavior or logic failure in the enginedata-integrityIssues relating to RAM state or SQLite database fidelityneeds:corpusNeeds the large local source corpora (main box only)priority: mediumscope:infraCI, tooling, churn/factory, docs infrastructure

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions