Skip to content

Trace Format #5425

@DavertMik

Description

@DavertMik

Prerequisistes:

  • investigate Playwright traces first and how they work

Task

Implement AI Native trace so AI agnets could read it, and debug

Proposed format: markdown file with CodeceptJS logs and links to stored data

file: tests/user_test.js
name: <test.fullName>
time: <executionTime>
---

I.amOnPage('/app') 
  > navigated to /app page
  > [HTML](./saved-html-of-this-page)
  > HTTP [GET /users](./request-response-stored-json-file) 200
  > [ARIA](./aria representation of the page)
  > [Screenshot](./screenshot of this page)
I.click(...)
  > HTTP [POST /users](./request-response-stored-json-file) 200
  [CodeceptJS Debug output]
  > Browser Logs: ...

Error: ....

So each CodeceptJS step should also store as separate files:

  • HTTP requests
  • HTML of page
  • ARIA snapshots
  • Screenshots of page

See step-by-step reporter plugin for reference

For each test we need to create uniq folder in output/... and store all related data there

Purpose

If a test fails coding agent like Claude Code can read the failure file, extract all needed information and provide a fix.
It can also re-run the test and see if data has changed

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions