[observability] Observability Coverage Report - 2026-08-14

[github-actions[bot]]

Executive Summary

The sampled observability coverage is healthy across the capped analysis set of 19 runs from the last 7 days, spanning 18 workflows. Every analyzed firewall-enabled run exposed an access.log, and every MCP-enabled run exposed MCP telemetry through rpc-messages.jsonl. No run in the sample was missing the core logs required to debug firewall egress or MCP activity.

The main gap is quality and richness rather than coverage. None of the sampled runs emitted preferred gateway.jsonl telemetry, so MCP analysis depended entirely on the canonical rpc-message/v2 fallback. That fallback was present and parseable in all 19 MCP-enabled runs, but it does not provide first-class per-call duration/status metrics the way structured gateway logs would.

Key Alerts and Anomalies

No critical issues detected.

Note

Core coverage is complete in this sample: firewall access.log coverage is 100.0% (19/19) and MCP telemetry coverage is 100.0% (19/19).

Warning

Preferred MCP gateway telemetry was absent in all 19 analyzed runs: gateway.jsonl coverage is 0/19, so duration and status metrics remain limited to what can be inferred from rpc-messages.jsonl.

Warning

Additional telemetry is slightly less complete than the core logs: safeoutputs.jsonl is missing in 3/19 analyzed runs.

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log)	19	19	100.0%	Healthy
MCP Gateway (gateway.jsonl or rpc-messages.jsonl)	19	19	100.0%	Healthy

📋 Detailed Run Analysis

Firewall-Enabled Runs

Workflow	Run ID	access.log	Entries	Allowed	Blocked	Status
Cache directory setup	§31754715689	Yes	137	78	59	Healthy
PR Sous Chef	§31753782727	Yes	49	16	33	Healthy
Detection Analysis Report	§31753524335	Yes	695	227	468	Healthy
PR Sous Chef	§31752692121	Yes	45	26	19	Healthy
Daily Reliability Review	§31752596834	Yes	143	85	58	Healthy
Daily BYOK Ollama Test	§31750168282	Yes	151	49	102	Healthy
Daily AWF Spec Compiler Surfacing Review	§31749758934	Yes	35	2	33	Healthy
ESLint Monster	§31748635275	Yes	23	14	9	Healthy
Duplicate Code Detector	§31748317675	Yes	191	85	106	Healthy
Daily Regulatory Report Generator	§31745571653	Yes	160	64	96	Healthy
Agentic Workflow Audit Agent	§31745489837	Yes	848	268	580	Healthy
Contribution Check	§31743976911	Yes	190	114	76	Healthy
Daily Caveman Optimizer	§31743356276	Yes	330	2	328	Healthy
Daily Project Performance Summary Generator (Using MCP Scripts)	§31743329840	Yes	468	128	340	Healthy
Copilot PR Prompt Pattern Analysis	§31743073820	Yes	82	38	44	Healthy
Avenger	§31741898782	Yes	246	106	140	Healthy
Lockfile Statistics Analysis Agent	§31740414176	Yes	101	38	63	Healthy
Daily Team Evolution Insights	§31740250422	Yes	160	46	114	Healthy
Issue Monster	§31740184594	Yes	43	24	19	Healthy

Missing Firewall Logs (access.log)

None.

MCP-Enabled Runs

Workflow	Run ID	Telemetry Source	Entries	Servers	Tool Calls	Errors	Status
Cache directory setup	§31754715689	rpc-messages.jsonl	8	2	1	0	Healthy
PR Sous Chef	§31753782727	rpc-messages.jsonl	4	1	1	0	Healthy
Detection Analysis Report	§31753524335	rpc-messages.jsonl	72	3	32	0	Healthy
PR Sous Chef	§31752692121	rpc-messages.jsonl	6	1	2	0	Healthy
Daily Reliability Review	§31752596834	rpc-messages.jsonl	8	2	1	0	Healthy
Daily BYOK Ollama Test	§31750168282	rpc-messages.jsonl	6	2	0	0	Healthy
Daily AWF Spec Compiler Surfacing Review	§31749758934	rpc-messages.jsonl	2	1	0	0	Healthy
ESLint Monster	§31748635275	rpc-messages.jsonl	4	1	1	0	Healthy
Duplicate Code Detector	§31748317675	rpc-messages.jsonl	48	3	19	0	Healthy
Daily Regulatory Report Generator	§31745571653	rpc-messages.jsonl	16	3	4	0	Healthy
Agentic Workflow Audit Agent	§31745489837	rpc-messages.jsonl	26	3	9	0	Healthy
Contribution Check	§31743976911	rpc-messages.jsonl	12	1	5	0	Healthy
Daily Caveman Optimizer	§31743356276	rpc-messages.jsonl	2	1	0	0	Healthy
Daily Project Performance Summary Generator (Using MCP Scripts)	§31743329840	rpc-messages.jsonl	38	2	17	0	Healthy
Copilot PR Prompt Pattern Analysis	§31743073820	rpc-messages.jsonl	8	2	1	0	Healthy
Avenger	§31741898782	rpc-messages.jsonl	4	1	1	0	Healthy
Lockfile Statistics Analysis Agent	§31740414176	rpc-messages.jsonl	8	2	1	0	Healthy
Daily Team Evolution Insights	§31740250422	rpc-messages.jsonl	114	2	38	0	Healthy
Issue Monster	§31740184594	rpc-messages.jsonl	14	1	6	0	Healthy

Missing MCP Telemetry (no gateway.jsonl or rpc-messages.jsonl)

None.

🔍 Telemetry Quality Analysis

Firewall Log Quality

• Total access.log entries analyzed: 4097
• Unique non-placeholder domains: 14
• Blocked requests: 2687 (65.6%)
• Most accessed domains: api.anthropic.com:443 (380), api.githubcopilot.com:443 (354), o205451.ingest.us.sentry.io:443 (242), otlp-gateway-prod-eu-west-2.grafana.net:443 (214)
• Path discovery note: all sampled firewall logs were discovered recursively under each run directory; the sampled files resolved to the legacy path form sandbox/firewall/logs/access.log rather than squid-logs/access.log.

MCP Log Quality

• Telemetry source: rpc-messages.jsonl fallback in all 19 MCP-enabled runs; gateway.jsonl was not present in the sample
• Total entries analyzed: 400
• MCP servers used: agenticworkflows, github, mcpscripts, safeoutputs, serena
• Total outgoing tools/call requests: 139
• Error rate: 0.0%
• Average response time: N/A from fallback schema without request/response duration pairing
• Schema note: sampled MCP logs were valid rpc-message/v2 JSONL with event, direction, server_id, and payload; requests also carried top-level method.

Additional Telemetry

• agent-stdio.log: 19/19
• agent_output.json or agent_output/: 19/19
• awf-config.json: 19/19
• aw_info.json: 0/19; current sampled layout used awf-config.json instead
• safeoutputs.jsonl: 16/19
• Daily BYOK Ollama Test §31750168282 is missing safeoutputs.jsonl.
• Daily AWF Spec Compiler Surfacing Review §31749758934 is missing safeoutputs.jsonl.
• Daily Caveman Optimizer §31743356276 is missing safeoutputs.jsonl.

Healthy Runs Summary

All 19 analyzed runs had the minimum firewall and MCP artifacts needed for post-incident debugging.

Recommended Actions

1. Emit gateway.jsonl alongside rpc-messages.jsonl so per-call durations and statuses are available without reconstructing protocol traffic.
2. Keep the current firewall artifact export path under regression watch; this sample had 100% access.log coverage and should remain a hard requirement.
3. Investigate the missing safeoutputs.jsonl artifacts in the three runs noted above so secondary output auditing is as reliable as the core firewall and MCP logs.

📊 Historical Trends

No prior local baseline was available in this workspace, so this report is a point-in-time sample rather than a trend comparison.

References: §31750168282, §31745489837, §31743356276

Generated by 📊 Daily Observability Report for AWF Firewall and MCP Gateway · gpt54 · 77 AIC · ⌖ 12.3 AIC · ⊞ 13.8K · ◷

• expires on Aug 14, 2026, 4:05 PM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by Daily Observability Report for AWF Firewall and MCP Gateway.

A newer discussion is available at Discussion #52795.