Repository navigation
Retrain archetype brains: labels have drifted from their trained state #4111
Copy link
Copy link
Open
Labels
archetype-retrainArchetype brains have drifted from their trained state (#4100)Archetype brains have drifted from their trained state (#4100)bugUnintended behavior or logic failure in the engineUnintended behavior or logic failure in the enginedata-integrityIssues relating to RAM state or SQLite database fidelityIssues relating to RAM state or SQLite database fidelityneeds:corpusNeeds the large local source corpora (main box only)Needs the large local source corpora (main box only)priority: mediumscope:infraCI, tooling, churn/factory, docs infrastructureCI, tooling, churn/factory, docs infrastructure
Description
The archetype brains have fallen out of step with the engine. Labels in DEGRADED levels are still emitted but qualified; INVALID levels are withheld (Unvalidated). This issue is opened, updated and closed by archetype-validation.yml (#4100) -- it closes itself once every level is back to VALIDATED or DRIFTING.
Current state
trained against engine v2.9.1 (44ffeb1, 2026-09-19); last measured at engine f81ab92 on language-crucible@v1.7.0
| Level | State | Agreement | Why |
|---|---|---|---|
| function | DRIFTING | 96.6% | engine changes since training relabelled 3.4% of crucible files (agreement 96.6%) |
| file | UNVALIDATED | -- | brain changed since the validation record was cut (fingerprint 104a9f96499b9010); note: 18/18 labels are unnamed cluster indices (e.g. 'file_cluster_0') -- reports show a cluster number, not an archetype |
| composition_file | DEGRADED | 96.4% | engine changes since training relabelled 3.6% of crucible files (agreement 96.4%); composition_file inputs disagree with the function model's labels: never read ['Annotated & Test Methods', 'Stateful Encapsulated Methods'], never emitted ['Annotated Framework Methods', 'Tests & Verification'] -- those units drop out and those input columns are always 0.0 |
| composition_repo | INVALID (withheld) | -- | not measurable on one corpus; inherits composition_file's measured state; composition_repo reads the composition_file brain labels by name, but none of its 20 inputs (e.g. 'Static: Literature & Documentation') is a label the composition_file brain emits (e.g. 'Annotated Framework Methods Files') -- every input column is 0.0 |
Eroding archetypes (share of trained-state members still assigned):
- function
C Struct Operations: 95.1% retained - function
Encapsulated Accessors: 85.6% retained - function
I/O & Config Routines: 92.5% retained - function
State Mutators: 93.4% retained - function
Stateful Encapsulated Methods: 86.4% retained - file
file_cluster_13: 97.4% retained, mostly to 'file_cluster_15' - file
file_cluster_15: 97.9% retained, mostly to 'file_cluster_10' - file
file_cluster_16: 55.6% retained, mostly to 'file_cluster_15' - file
file_cluster_6: 94.5% retained, mostly to 'file_cluster_4' - file
file_cluster_8: 81.6% retained, mostly to 'file_cluster_6' - file
file_cluster_9: 92.3% retained, mostly to 'file_cluster_2' - composition_file
Callbacks & Closures Files: 95.3% retained, mostly to 'Large Core Modules (2)' - composition_file
Compute Cores Files: 95.4% retained, mostly to 'Large Core Modules (3)' - composition_file
Encapsulated Accessors Files: 83.0% retained, mostly to 'Large Core Modules (2)' - composition_file
Interface Declarations Files: 98.0% retained, mostly to 'Large Core Modules' - composition_file
Large Core Modules: 92.1% retained, mostly to 'Interface Declarations Files' - composition_file
Large Core Modules (3): 90.4% retained, mostly to 'Interface Declarations Files' - composition_file
Many-Argument Workhorses Files: 90.0% retained, mostly to 'Large Core Modules (2)' - composition_file
State Mutators Files: 93.5% retained, mostly to 'Parameter Forwarders Files'
Agreement = share of crucible code files labelled as at training; stability, not accuracy.
Clearing it
- Retrain/refreeze the brains in gitgalaxy-population-analyses on a current fleet scan.
- Land them here with the paired engine review (
EXPECTED_CONTRACT_SHAintests/core_engine/test_archetype_parity.py) and a golden-master re-bless. - Re-anchor the drift baseline on the engine the brains were trained against:
python tests/tools/archetype_drift.py rebaseline --audit <crucible audit> --engine-version vX.Y.Z --engine-commit <sha> --trained-at <date> --corpus <corpus>
Recent measurements
| Date | Engine | function | file | composition_file | composition_repo |
|---|---|---|---|---|---|
| 2026-10-02 | aaf0f7cb |
98.6% VALIDATED | 99.3% VALIDATED | 97.8% DEGRADED | INVALID |
| 2026-10-02 | 575c3900 |
98.5% VALIDATED | 98.8% VALIDATED | 97.7% DEGRADED | INVALID |
| 2026-10-04 | 2d7052cc |
98.4% VALIDATED | 98.8% VALIDATED | 97.4% DEGRADED | INVALID |
| 2026-10-05 | 49cba5db |
98.4% VALIDATED | 98.7% VALIDATED | 97.4% DEGRADED | INVALID |
| 2026-10-19 | f8462915 |
98.4% VALIDATED | UNVALIDATED | 97.2% DEGRADED | INVALID |
| 2026-10-20 | c1432265 |
98.4% VALIDATED | UNVALIDATED | 97.1% DEGRADED | INVALID |
| 2026-10-24 | c85b4481 |
98.0% VALIDATED | UNVALIDATED | 97.0% DEGRADED | INVALID |
| 2026-10-25 | 553e936d |
98.0% VALIDATED | UNVALIDATED | 97.0% DEGRADED | INVALID |
| 2026-10-26 | f81ab92c |
96.6% DRIFTING | UNVALIDATED | 96.4% DEGRADED | INVALID |
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
archetype-retrainArchetype brains have drifted from their trained state (#4100)Archetype brains have drifted from their trained state (#4100)bugUnintended behavior or logic failure in the engineUnintended behavior or logic failure in the enginedata-integrityIssues relating to RAM state or SQLite database fidelityIssues relating to RAM state or SQLite database fidelityneeds:corpusNeeds the large local source corpora (main box only)Needs the large local source corpora (main box only)priority: mediumscope:infraCI, tooling, churn/factory, docs infrastructureCI, tooling, churn/factory, docs infrastructure
Activity
squid-protocol commentedon Oct 3, 2026
Note for the next retrain:
feature_flagsis being retired (#4114, closed not-planned). In the same change as the retrain, remove it fromSIGNAL_SCHEMA,SURFACE_FAMILIES['debt'], thearch_feature_flagscolumn,log_density_arch_feature_flagsin the file brain's feature list, andtests/signal_coverage_baseline.json, so the feature-dimension change rides on this retrain instead of forcing a second one.squid-protocol commentedon Oct 18, 2026
Waiting on an owner decision (asked privately, 2026-10-18). Nothing is needed from contributors; work resumes once it is answered.
golden: re-bless for the feature_flags retirement (Part of #4111)
Merge origin/main into churn/4111; re-bless goldens (Part of #4111)
archetypes: retire feature_flags and project the file brain without i…
7 remaining items
squid-protocol commentedon Oct 24, 2026
Churn run
4111-20261024T0437Z(host nyx) ended without a PR. blocked: needs owner decision + retrain in population-analyses; not requeuesquid-protocol commentedon Oct 24, 2026
Churn run
4111-20261024T1803Z(host melek) ended without a PR. no PR; blocked on owner decision + retrain in population-analyses; do not requeuesquid-protocol commentedon Oct 24, 2026
Churn run
4111-20261024T1822Z(host nyx) ended without a PR. no PR; blocked on owner decision + retrain; do not requeuesquid-protocol commentedon Oct 25, 2026
Churn run
4111-20261025T0855Z(host melek) ended without a PR. No code change; #4111 waits on owner decision + population-analyses retrain. Not requeued.