Skip to content

Confirming a high-blast-radius verb over a lossy channel #7

Open

Description

@Pierre-Mike

Question

How does a destructive or expensive action get confirmed when the input channel mishears?

README.md in ~/Github/pipecat-voice-agent already names the risk: with write tools and nobody at a keyboard, "a misheard sentence becomes a command." Decide:

  • Whether high-blast-radius verbs are confirmed by spoken readback, deferred to a visual surface the user clicks, or excluded from the vocabulary outright.
  • What the confirmation utterance is, and how a "yes" that was really background speech gets rejected.
  • Whether AGENT_PERMISSION_MODE is set at all, and to what, given the brain that was chosen.
  • Whether an Orca decision gate is the right primitive for a spoken confirmation, so the record lives in Orca rather than only in audio.

Depends on the chosen brain, because the confirmation mechanism differs between an SDK session and a TUI session, and on which verbs are owned.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions