Repository navigation
Third-party ports through the harness: Lightyear and SENTINEL IDE; external-fault experiment - #4194
Merged
Merged
Conversation
…e equivalence harness; external faults The pattern of #4177 / #4190: each port fetched at a pinned commit (no licence on either repository: nothing of theirs committed), built as it ships (SENTINEL: its program classes compiled as they are, the project's three non-compiling files are none of them), run on our cases' inputs as text lines, judged by compare_run in full / data / clock-masked tiers. --external-faults reproduces each case fault that is an input OPEN failing with status 35 by running the port with that file absent, for these ports and Devin's eval arms. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ
…nal-fault experiment (with Devin's eval arms) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
| import argparse | ||
| import json | ||
| import re | ||
| import subprocess |
Contributor
squid-protocol
added a commit
that referenced
this pull request
Oct 3, 2026
…e runs, missing-file experiment; §9-§11 updated Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ
squid-protocol
added a commit
that referenced
this pull request
Oct 3, 2026
…canner, many translators (draft) (#4192) * docs(research): COBOL->Java translation, observed -- one harness, one scanner, many translators (draft) Blameless, post-hoc observational study across GitGalaxy's det and model ports, IBM WCA4Z's LGACDB01 artifact, Devin workshop ports, SENTINEL IDE, lasserre, Lightyear and an academic API-recovery study. Sections for SENTINEL I/O (#4191), Lightyear/SENTINEL harness runs and the external-fault experiment are marked pending. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ * docs(research): §10 translation strategies compared, and what each teaches Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ * docs(research): §4 SENTINEL I/O after #4193 -- agreement depends on the scanner recognising a translator's runtime vocabulary Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ * docs(research): §6/§8 filled from #4194 -- Lightyear and SENTINEL base runs, missing-file experiment; §9-§11 updated Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ * docs(research): CBACT01C in §6.1 and §7 (#4198) -- 9 Devin runs, structure against verdict; register A1/C10/L3/F3; counts 49/51 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ * docs(research): scenario count scoped to the 50-case sweep Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ * docs(research): SQL fault injection (#4200) -- instruments, Db2 coverage before/after, our own bugs fixed, register M2/X6/X10/X11 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Runs two more public CardDemo Java ports through our equivalence harness, following the pattern of #4177 (IBM) and #4190 (Devin). Each is fetched at a pinned commit and never committed (neither repository has a licence), built as it ships, and judged by
compare_runin three tiers: full, data and clock-masked. Results and root causes are indocs/research/third-party-ports-harness.md.Results:
String.formatdefect (ZonedDecimal.java:47,InterestCalculationService.java:94).toString()).XREF-ACCT-IDread at offset 16, where the copybook puts it at 25.DALYTRAN-AMTread as 12 bytes instead of 11, shifting the card number. Its reject records are 361 bytes against 430.Not run, with reasons: SENTINEL CBTRN01C and CBTRN03C (they ship only reader interfaces), SENTINEL COBTUPDT (Db2), and Lightyear COACTVWC (not a CICS-shaped port).
Adapter:
tests/tools/thirdparty_port.pyandtests/tools/thirdparty/adapter/(a program launcher plus a message-only logback config). Unit tests are intests/cobol_mainframe/test_thirdparty_port.py.🤖 Generated with Claude Code
https://claude.ai/code/session_01RZE6us7fUL6Hynk59rWLvZ