Skip to content

Record agent install outcomes - #5944

Closed
brsbl wants to merge 1 commit into
mainfrom
bb/agent-install-telemetry
Closed

brsbl wants to merge 1 commit into
mainfrom
bb/agent-install-telemetry

Conversation

@brsbl

@brsbl brsbl commented Oct 21, 2026 •

Copy link
Copy Markdown
Collaborator

Human comments

What was wrong

No event recorded whether installing an agent from bb succeeded or failed, so install failures by agent and OS were invisible.

What changed

  • bb sends anonymous agent_install_started and agent_install_finished events when an agent install runs.
  • Events carry the agent, the install method and the outcome; third-party agents are never named.
  • Ships ahead of the install fixes, so today's install failure rate can be measured first.
  • On by default. BB_FF_AGENT_INSTALL_TELEMETRY=false turns them off, and the telemetry opt-out still applies.

How you verified

  • Server tests: events send for built-in agents and stay off with the flag or for third-party agents.
  • Remote CI passed, including Windows tests.
  • Known gap: an install that times out or loses its host before reporting back records no events.

BB-Thread-ID: thr_k52en5smyw

AGENT GENERATED

@brsbl
brsbl added this pull request to stack #5945 October 21, 2026 00:23
@brsbl brsbl changed the title Record agent install outcomes behind an off-by-default flag Record agent install outcomes Oct 21, 2026
@brsbl
brsbl force-pushed the bb/agent-install-telemetry branch from d1d8283 to 57f6a9c Compare October 21, 2026 16:51
@brsbl
brsbl removed this pull request from stack #5945 October 21, 2026 16:52
@brsbl
brsbl changed the base branch from bb/pi-bundled-runtime to main October 21, 2026 16:52
@brsbl
brsbl marked this pull request as ready for review October 21, 2026 16:52
@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ⚠️ Failed 2026-10-21T16:52:45.559084Z
We couldn’t complete this review. Comment @codex review to try again.
57f6a9c Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, add credits to your account and enable them for code reviews in your settings.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@brsbl
brsbl force-pushed the bb/agent-install-telemetry branch 2 times, most recently from 54e7593 to fb4c721 Compare October 21, 2026 18:55
@github-actions github-actions Bot closed this Nov 4, 2026
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

This is an automated message. We have closed this pull request because it has been open for more than two weeks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant