-
-
Notifications
You must be signed in to change notification settings - Fork 753
Open
Labels
Description
Prerequisistes:
- investigate Playwright traces first and how they work
Task
Implement AI Native trace so AI agnets could read it, and debug
Proposed format: markdown file with CodeceptJS logs and links to stored data
file: tests/user_test.js
name: <test.fullName>
time: <executionTime>
---
I.amOnPage('/app')
> navigated to /app page
> [HTML](./saved-html-of-this-page)
> HTTP [GET /users](./request-response-stored-json-file) 200
> [ARIA](./aria representation of the page)
> [Screenshot](./screenshot of this page)
I.click(...)
> HTTP [POST /users](./request-response-stored-json-file) 200
[CodeceptJS Debug output]
> Browser Logs: ...
Error: ....
So each CodeceptJS step should also store as separate files:
- HTTP requests
- HTML of page
- ARIA snapshots
- Screenshots of page
See step-by-step reporter plugin for reference
For each test we need to create uniq folder in output/... and store all related data there
Purpose
If a test fails coding agent like Claude Code can read the failure file, extract all needed information and provide a fix.
It can also re-run the test and see if data has changed