Skip to content

feat(materials): add RADAMSA_REPORT and RADAMSA_CRASHES material types#3218

Merged
javirln merged 1 commit into
chainloop-dev:mainfrom
javirln:javirln/radamsa-material-types
Jun 17, 2026
Merged

feat(materials): add RADAMSA_REPORT and RADAMSA_CRASHES material types#3218
javirln merged 1 commit into
chainloop-dev:mainfrom
javirln:javirln/radamsa-material-types

Conversation

@javirln

@javirln javirln commented Jun 17, 2026

Copy link
Copy Markdown
Member

Adds two material types for ingesting radamsa fuzzing evidence into Chainloop attestations:

  • RADAMSA_REPORT — radamsa's -M metadata log (one record per generated iteration), projected to input.elements so policies can assert a minimum iteration count.
  • RADAMSA_CRASHES — crashing inputs, either a single file or a crashes/ archive (tar.gz or zip). Metadata-only: annotated with a crash count and excluded from policy content evaluation (both filesystem-read and inline content paths).

Includes a shared -M log parser subpackage, both crafters wired into the crafting switch, and the policy-engine content handling. The new types are intentionally not added to the material auto-detection list, since RADAMSA_CRASHES single-file mode would eagerly shadow other types; they are used via an explicit kind in workflow contracts.

AI assistance

This contribution was produced with the assistance of Claude Code. Affected commits carry an Assisted-by: Claude Code trailer.

Review in cubic

@chainloop-platform

chainloop-platform Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

AI Session Analysis

Avg score Sessions Failing policies Attribution Files Lines Total Duration
🟢 84% 1 ✅ 0 98% AI / 2% Human 13 +683 / -4 1h29m27s

🟢 84% — 98% AI — ✅ All policies passing

Jun 17, 2026 11:02 UTC · 1h29m27s · $48.16 · 100.0k in / 326.0k out · claude-code 2.1.170 (claude-opus-4-8)

View session details ↗

Change Summary

  • Adds RADAMSA_REPORT and RADAMSA_CRASHES material types plus generated schema and CLI-doc updates.
  • Adds the shared Radamsa -M parser, both crafters, fixtures, and crafter tests.
  • Extends policy-evaluation content handling for Radamsa materials and tightens parser/archive edge cases after review.

AI Session Overall Score

🟢 84% — Strong planning and verification; one premature completion claim kept alignment from fully green.

AI Session Analysis Breakdown

🟢 93% · context-and-planning

🟢 Validated multi-section plan existed before implementation started. · High Impact

🟢 90% · verification

🟢 Manual CLI evaluation exposed a missed bug before the final commit. · High Impact

🟢 86% · scope-discipline

No notes.

🟢 85% · solution-quality

🟢 Review comments produced new parser and archive edge-case tests. · Medium Impact

🟢 84% · user-trust-signal

No notes.

🟡 70% · alignment

🟠 The AI declared the Radamsa work verified before later manual testing exposed an inline RADAMSA_CRASHES bug. · Medium Severity

💡 Before summarizing a feature as done, exercise the highest-risk manual path once and let that result drive the claim.


File Attribution

███████████████████░ 98% AI / 2% Human

Status Attribution File Lines
created ai pkg/attestation/crafter/materials/radamsa.go +211 / -0
created ai pkg/attestation/crafter/materials/radamsa_test.go +186 / -0
created ai pkg/attestation/crafter/materials/radamsa/parse.go +126 / -0
created ai pkg/attestation/crafter/materials/radamsa/parse_test.go +77 / -0
modified ai pkg/attestation/crafter/api/attestation/v1/crafting_state_test.go +43 / -0
modified ai pkg/attestation/crafter/api/attestation/v1/crafting_state.go +18 / -2
modified ai app/controlplane/api/workflowcontract/v1/crafting_schema.proto +5 / -0
modified human app/cli/documentation/cli-reference.mdx +2 / -2
modified ai app/controlplane/api/workflowcontract/v1/crafting_schema_validations.go +4 / -0
modified ai pkg/attestation/crafter/materials/materials.go +4 / -0
created ai pkg/attestation/crafter/api/attestation/v1/testdata/radamsa-meta.txt +3 / -0
created human pkg/attestation/crafter/materials/testdata/radamsa-meta.txt +3 / -0
created ai pkg/attestation/crafter/materials/testdata/radamsa-meta-invalid.txt +1 / -0

Policies (4)

Status Policy Material Messages
✅ Passed ai-config-ai-agents-allowed ai-coding-session-72f7fe -
✅ Passed ai-config-no-dangerous-commands ai-coding-session-72f7fe -
✅ Passed ai-config-no-secrets ai-coding-session-72f7fe -
✅ Passed ai-config-mcp-servers-allowed ai-coding-session-72f7fe -

Powered by Chainloop and Chainloop Trace

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 issues found across 27 files

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

Comment thread pkg/attestation/crafter/materials/radamsa/parse.go
Comment thread pkg/attestation/crafter/materials/radamsa.go Outdated
Add two material types for radamsa fuzzing evidence:
- RADAMSA_REPORT: radamsa -M metadata log, projected to input.elements for
  policy evaluation
- RADAMSA_CRASHES: crashing inputs (single file or tar.gz/zip archive),
  metadata-only with a crash-count annotation

Includes a shared -M log parser subpackage, both crafters, and policy-engine
content handling that treats crash content as metadata-only (excluded from
filesystem reads and discarded when inline).

Assisted-by: Claude Code
Signed-off-by: Javier Rodriguez <javier@chainloop.dev>

Chainloop-Trace-Sessions: 72f7fee5-d0c0-4328-a27b-319e49087aa6
Signed-off-by: Javier Rodriguez <javier@chainloop.dev>
@javirln javirln force-pushed the javirln/radamsa-material-types branch from 2306097 to 8cffc33 Compare June 17, 2026 12:32
@javirln javirln merged commit 21cc2ec into chainloop-dev:main Jun 17, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants