Skip to content

docs(spec): Define image box answers - #68

Merged
Luca Forstner (lforst) merged 3 commits into
mainfrom
lforst/dum-e/venice-bc813ca142
Oct 15, 2026
Merged

Luca Forstner (lforst) merged 3 commits into
mainfrom
lforst/dum-e/venice-bc813ca142

Conversation

@lforst

Copy link
Copy Markdown
Member
  • Specify how decision spans capture image regions using box answers with normalized coordinates and optional confidence.
  • Define coordinate conversion and preserve answers with low confidence or unexpected values without breaking application calls.
  • Keep boxes and other answers in one span, matched to questions by ID, and reuse existing image attachment handling.
  • Track box support as unknown across SDKs.

@lforst
Luca Forstner (lforst) merged commit e9a1ad3 into main Oct 15, 2026
4 checks passed
Luca Forstner (lforst) added a commit to braintrustdata/braintrust-sdk-javascript that referenced this pull request Oct 15, 2026
Ref: braintrustdata/braintrust-spec#68

Adds image and box instrumentation for TypeSafe SDK 0.7 while retaining
coverage for 0.6.
Calls emit one `decision` span containing all questions and answers,
including mixed box, Noul, Choice, and Score results.
Images stay in their logged input locations, and box answers get an
`image_path` when the image association is unambiguous.
Attachment capture remains opt-in and uses the shared export pipeline
for customization and upload fallback.

Adds pinned/latest e2e coverage for both version lines, recorded
provider cassettes, and paired JSON/text span-tree snapshots.
The cassette harness can opt into inline request bodies so multipart
image requests match during replay.

Verified build/lint, 33 focused tests, and three e2e replay runs with 36
passing tests each.
Verified all four summary links against 24 production traces.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants