Skip to content

[7/10] Define per-layer specs and component contracts - #1061

Open
jiapingW wants to merge 1 commit into
split/config-component-extractionfrom
split/config-layer-contracts
Open

jiapingW wants to merge 1 commit into
split/config-component-extractionfrom
split/config-layer-contracts

Conversation

@jiapingW

@jiapingW jiapingW commented Nov 1, 2026 •

Copy link
Copy Markdown
Collaborator

Add immutable AttentionSpec/FFNSpec/ResidualSpec/ConvSpec grouped into LayerSpec, a decoder and an open registry of specs/builders. Keep these definitions together under config/draft/layers/ as specs.py, decoder.py and registry.py. Expand shared settings into a per-layer tuple and validate execution contracts and unknown fields.

Existing model call sites stay unchanged here; the next PR adopts these interfaces.

Depends on #1060.

Validation: 643 CPU-suite tests completed, 48 skipped.

Stack: #1042 → #1043 → #1058 → #1059 → #1044 → #1060 → #1061 → #1052 → #1045 → #1046.
Independent CPU CI: #1053.

@jiapingW
jiapingW force-pushed the split/config-layer-contracts branch from 436969a to a854575 Compare November 1, 2026 06:11
@jiapingW
jiapingW force-pushed the split/config-component-extraction branch from 8258522 to 61f1199 Compare November 1, 2026 06:11

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant