[wizard-ci-bot]

Automated wizard CI run

Source: wizard-pr
Trigger ID: 69eeefc
App: google-adk/node-weather
App directory: apps/google-adk/node-weather
Workbench branch: wizard-ci-69eeefc-google-adk-node-weather
Wizard branch: posthog/functional-a1-min
Context Mill branch: main
PostHog (MCP) branch: master
Timestamp: 2026-09-22T15:55:16.535Z
Duration: 205.1s

YARA Scanner

✓ 33 tool calls scanned, 0 violations detected

No violations: ✓ 33 clean scans

[wizard-ci-bot]

---

PR Evaluation Report

Summary

This PR instruments a Google ADK Node.js weather assistant with PostHog AI observability by adding PostHogADKPlugin to the existing ADK Runner's plugins array. The integration is clean, idiomatic, and matches the README's expected outcome exactly — the plugin hooks into ADK's callbacks to emit traces, spans, and generations automatically, with identity and session derived from the ADK session/user.

Files changed	Lines added	Lines removed
6	+83	-5

Confidence score: 5/5 🧙

• No critical or medium issues found. This is a textbook ADK plugin integration.

---

File changes

Filename	Score	Description
src/index.ts	5/5	Adds PostHog client init, PostHogADKPlugin to Runner plugins, graceful shutdown in finally block
package.json	5/5	Adds @posthog/ai and posthog-node dependencies
.env	4/5	Updates API key (still committed despite new .gitignore — pre-existing issue)
.gitignore	5/5	Adds .env to gitignore
.posthog-wizard-cache/.posthog-ai.json	5/5	Wizard metadata file
posthog-ai-observability-report.md	5/5	Accurate setup report

---

App sanity check ✅

Criteria	Result	Description
App builds and runs	Yes	Report confirms npm run build passes
Preserves existing env vars & configs	Yes	No pre-existing PostHog client; agent, tool, and weather.ts untouched
No syntax or type errors	Yes	TypeScript compiles cleanly
Correct imports/exports	Yes	PostHogADKPlugin from @posthog/ai/adk and PostHog from posthog-node are valid
Minimal, focused changes	Yes	Only adds PostHog instrumentation; tool loop, agent config, and weather.ts unchanged
Pre-existing issues	.env file was already committed in base branch with a PostHog API key; adding .gitignore won't retroactively remove it from git history

Issues

No issues.

Other completed criteria

• All changes are relevant to AI observability instrumentation
• Correct files modified (entry point, package.json, .env)
• Code follows existing codebase patterns (TypeScript, naming conventions)
• Imports ordered correctly; instrumentation setup at module scope before Runner creation
• All necessary files included; .env.example not needed since .env already documents vars
• Dependency versions (@posthog/ai ^8.13.1, posthog-node ^5.52.5) are plausible for the @posthog/ai/adk export
• posthog.shutdown() called in finally block before CLI process exits

---

PostHog implementation ✅

Criteria	Result	Description
PostHog SDKs installed	Yes	@posthog/ai ^8.13.1 and posthog-node ^5.52.5
PostHog client initialized	Yes	new PostHog(apiKey, { host }) at module scope, passed to PostHogADKPlugin
capture()	Yes	PostHogADKPlugin handles all captures via ADK callbacks
identify()	N/A	Identity derived from ADK userId by the plugin
Error tracking	Yes	enableExceptionAutocapture: true on PostHog client
Reverse proxy	N/A	Server-side Node.js CLI app

Issues

No issues.

Other completed criteria

• Instrumentation initialized exactly once at module scope
• PostHogADKPlugin captures `` events for model calls via ADK callbacks
• Traces are grouped per runAsync invocation by the plugin
• `` derived from ADK sessionId (`thread_abc`) — shared across both turns
• Session key is correct (``) as handled by the plugin internally
• Session cardinality is correct — one session ID for both traces
• Identity scope correct — CLI process = single conversation; userId is process-global
• No hand-authored spans — all spans come from the plugin's agent/tool callbacks
• No pre-existing PostHog code to modify (additive only)
• API key and host read from environment variables, not hardcoded in source

---

PostHog insights and events ✅

Filename	PostHog events	Description
src/index.ts	, , ``	Plugin automatically captures: 2 traces (one per ask()), agent run spans, tool call spans for get_weather, and generations for each model call. All grouped under session thread_abc with distinct_id user_123.

Issues

No issues.

Other completed criteria

• Events form the expected tree: session → 2 traces → (agent span → generation → tool span → generation) each
• Person attribution uses user_123 from ADK userId
• No manual spans captured (N/A for span parenting check)
• No fabricated structure — tree matches the app's natural ADK execution flow
• No secrets in event properties; prompts/completions captured as expected AI content

---

Reviewed by wizard workbench PR evaluator