Skip to content

audit: help and docs name the agents it reads (#811) - #819

Merged
LoopGlitch26 merged 3 commits into
Cygnux-Labs:mainfrom
hayatexe:agent/issue-811
Nov 14, 2026
Merged

LoopGlitch26 merged 3 commits into
Cygnux-Labs:mainfrom
hayatexe:agent/issue-811

Conversation

@hayatexe

Copy link
Copy Markdown
Contributor

What and why

Fixes #811. tracekit audit reads Claude Code, Cursor and Cline today, but the help and two docs still said Claude Code only, and the audit description listed agents by hand.

  • tracekit --help: the audit line says "their transcripts, see docs/audit.md, or a calls file", with no agent list to go stale.
  • tracekit audit --help: the description's list is built from READERS, like the root argument's help.
  • README.md and docs/support.md point at audit's readers table instead of naming agents.
  • tests/test_audit.py::test_help_names_every_reader checks the description (not the usage line, whose --agent choices name them anyway) names every key of READERS; it fails on main.

How I ran it as a user

tracekit --help:

    audit               replay your coding agents' past tool calls (their transcripts, see docs/audit.md, or a calls
                        file) through the policy and count what it would have held or denied; read-only, not a signed
                        record

tracekit audit --help:

usage: tracekit audit [-h] [--calls FILE]
                      [--agent {antigravity,claude,cline,codebuddy,codex,copilot,crush,cursor,devin,droid,gemini,goose,gptme,kilo,opencode,openhands,qwen}]
                      [--policy POLICY] [--since SINCE] [--show] [--all] [--json | --share]
                      [root]

replay the tool calls in your coding agents' transcripts (claude, cursor, cline), or in a calls file any agent's log
can be turned into, through the policy and count what it would have held or denied. Read-only, local, and a replay
against today's policy, not a signed record.

pytest tests/test_audit.py tests/test_docs.py tests/test_eval_docs.py: 68 passed, 2 skipped, 2 failed. Both failures are the same on main on my Windows machine: test_docs.py::DocLinks::test_relative_links_resolve (links into examples/v2/demos/) and the gptme subtest of test_the_guard_line_names_the_calls_files_agent. pyflakes clean.

Checklist

  • make check passes (lint, tests, build); make test-ts too if sdk/typescript/ changed
  • a regression test covers the change
  • user-visible changes are described above (release notes are written at release time; don't edit CHANGELOG.md)
  • docs updated if behaviour or a security claim changed
  • every commit is signed off (git commit -s, see CONTRIBUTING.md)

Security invariants

  • the agent still never holds a signing key or assigns sequence numbers
  • nothing an agent-controlled process supplies (isolation level, fail mode, gap/tamper records, approval identity) is newly trusted by the signer or verifier
  • gaps are still signed, never silent; a check that cannot run warns instead of passing
  • no verification code is shipped inside a bundle

Evidence format

  • this change does not touch the frozen formats

…bs#811)

tracekit --help points at docs/audit.md instead of saying Claude Code
only; tracekit audit --help builds its agent list from READERS; README
and docs/support.md link audit's readers table. A test checks the
description names every reader.

Signed-off-by: hayatexe <145812188+hayatexe@users.noreply.github.com>
Copilot AI lite review requested due to automatic review settings November 13, 2026 13:06

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota.

An organization owner can choose the repository organization as the billing source for reviews requested by members with a paid Copilot license. Learn about Copilot code review billing.

@hayatexe

Copy link
Copy Markdown
Contributor Author

The Lint failures here come from main, not this change: tests/test_bounded.py:363: redefinition of unused 'signer_without_fsync' from line 22 (the import from factories added in #806 and the local definition below it). This PR doesn't touch that file. Happy to rebase once main is fixed.

@LoopGlitch26

Copy link
Copy Markdown
Member

Good catch, thank you: two PRs that each passed CI alone, merged together. The fix is in #820. Once it's on main, your PR's lint job will pass on a re-run, and you don't need to rebase.

@LoopGlitch26

Copy link
Copy Markdown
Member

Main is fixed now (#820, the lint error and the gptme audit test that failed every PR's CI). Please merge main into your branch so CI runs against it; a re-run alone reuses the old combined snapshot.

Signed-off-by: hayatexe <145812188+hayatexe@users.noreply.github.com>
@LoopGlitch26

Copy link
Copy Markdown
Member

#764 has merged, and it also edits audit's help and docs (it adds Gemini CLI to READERS). Please merge main and resolve the conflict. Your approach of building the list from READERS stays, so gemini will show up by itself; drop any agent names #764 wrote by hand in the files you change.

Signed-off-by: hayatexe <145812188+hayatexe@users.noreply.github.com>

# Conflicts:
#	docs/support.md
#	tracekit/audit.py
#	tracekit/cli.py
@LoopGlitch26
LoopGlitch26 enabled auto-merge (squash) November 14, 2026 00:31
@hayatexe

Copy link
Copy Markdown
Contributor Author

Done — merged main and resolved the conflict in tracekit/audit.py, tracekit/cli.py and docs/support.md. Kept the READERS-driven list (so gemini shows up on its own) and dropped the hand-written agent names from #764 in those files; #764's other changes (the gemini reader and the audit.md readers table) are untouched. pyflakes is clean and tests/test_audit.py / tests/test_docs.py pass.

@LoopGlitch26
LoopGlitch26 merged commit 749d4f6 into Cygnux-Labs:main Nov 14, 2026
32 of 34 checks passed
@LoopGlitch26

Copy link
Copy Markdown
Member

Merged, thank you, and thanks for sorting out the conflict with #764. tracekit audit's help and docs now take the agent list from READERS, so Gemini CLI shows up there, and so will the next reader someone adds.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

tracekit audit: help text and README say it reads Claude Code only

3 participants