Port recent OpenRoomote changes (#547, #548) - #1
Merged
Conversation
A scenario JSON carries authored success criteria; the runner drives the mock Slack harness against the live local stack, captures every outbound message, and emits a bundle for the RooCodeInc/opencode-bench judge panel, which scores each criterion binary against the transcript. Two scenarios to start: !fast answer quality and duplicate-delivery dedup (both inline, no cloud job). Guidance doc added under operations. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Roomote <roomote@roocode.com>
|
No code issues found. See task Reviewed both ported changes against the current repo state:
Clean, well-scoped port. |
Contributor
|
All contributors have signed the CLA. |
Contributor
Author
|
I have read the CLA Document and I hereby sign the CLA |
1 similar comment
Member
|
I have read the CLA Document and I hereby sign the CLA |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ports the two OpenRoomote changes that landed after this repo's split point (OpenRoomote #544), cherry-picked with original authorship preserved.
Changes
eval:scenarioscript inpackages/slack, the runner atpackages/slack/evals/run-slack-scenario.ts, two starter scenarios (!fastanswer quality, duplicate-delivery dedup), and a guidance doc at.agent-guidance/operations/slack-behavior-evals.md. Applied cleanly.RENDER_EXTERNAL_HOSTNAMEin.docker/app/entrypoint.shplus a troubleshooting section indeploy/render/README.md. The README hunk auto-merged against this repo's diverged copy; reviewed and correct in context.How the port was scoped
This repo was cut from OpenRoomote with history squashed, so the split point was located by scanning OpenRoomote history for the commit whose tree is closest to this repo's initial commit: OpenRoomote
affc9a93(#544). The remaining ~80-file baseline difference is the intentional split transformation (squashed Drizzle migrations, removedcli/emailpackages, deploy/docs/CI edits). Only these two commits postdate it.Validation
@roomote/slacktypecheck and lint pass; Prettier clean on all ported filessh -nsyntax check on the entrypoint scriptlint:fast,check-types:fast,knip) passed