user-experience:evaluate misses below-the-fold actions, ambiguous view copy and stale in-product screenshots #7655

Activity

1. github-actions

   added

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 16, 2026
2. github-actions commented on Oct 16, 2026

   

   github-actionsBot

   on Oct 16, 2026 – with GitHub Actions

   Contributor

   More actions

   Thanks for the detailed writeup. I understood this as three gaps in /user-experience:evaluate: it doesn't check multi-device fold visibility of the primary action, doesn't scan on-screen copy for view-ambiguous references ("this page"), and doesn't compare in-product screenshots against the live screen/theme or check for upscaling. The proposed changes and acceptance criteria (new failing-then-passing eval cases per gap, no regression in existing evals) are concrete enough to act on without further clarification. I didn't find an existing open issue covering the same gaps. No related-issue link was given, which matches the "found while dogfooding" note in the body.

   _{Automated triage. A maintainer reviews it.}
3. github-actions

   added

   help wantedMaintainer would welcome help.Maintainer would welcome help.

   priority: mediumReal value, no hard deadline; normal backlog flow.Real value, no hard deadline; normal backlog flow.

   and removed

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 16, 2026
4. github-actions

   added the

   Feature

   issue type on Oct 16, 2026
5. kyle-sexton commented on Oct 18, 2026

   

   kyle-sexton

   on Oct 18, 2026

   MemberAuthor

   More actions

   Agent Brief

   Type: Feature
   Summary: Add fold visibility, view-ambiguous copy and stale in-product picture checks to the /user-experience:evaluate expert review of a live app.

   Current behavior:
   An expert review of a live, multi-view web app does not check whether the primary action is visible without scrolling at any screen size, does not read the questions, labels and instructions the app shows, and does not compare pictures of the product shown inside it with the live screen.

   Desired behavior:
   For a live app the method:

   • walks each task at a phone, a tablet and a desktop size and records per step whether the primary action and the thing being asked about are on screen without scrolling;
   • reads every question, label and instruction the app shows and flags words such as 'this page', 'here' or 'this one' that could point at more than one view, element or device;
   • compares each screenshot or picture of the product shown inside it with the live screen and theme, and checks natural against displayed size; a mismatch or an upscale is a finding.

   Key interfaces:

   • The evaluate skill's expert-review method for a live app.
   • Its eval set (skill-creator evals.json format).

   Acceptance criteria:

   • The method states all three checks (read from the diff).
   • evals.json gains three cases: a page whose primary action sits below the fold at desktop size, whose expectations require the fold finding; a 'what would you change about this page?' question in a three-view app, whose expectations require the ambiguity finding; an upscaled, out-of-date in-product screenshot, whose expectations require the mismatch finding.
   • The existing eval cases are unchanged (read from the diff).
   • The user-experience plugin version is bumped with a CHANGELOG entry.

   Out of scope:

   • Running the evals to show each new case fails before and passes after, and the no-loss check on existing evals (paid eval run, after merge).
   • Other user-experience skills.

   ---

   This was generated by AI during backlog shaping. Held, not admitted: this brief is drafted and checked, but the issue lane would stop on it today. It is admitted, by adding agent-ready, once the lane can run the skill-quality check scripts (Automation Lanes' PR #7912). Held under the owner's 2026-10-18 lane-narrowing course correction.
6. kyle-sexton

   added

   needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

   agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.Fully specified and briefed; eligible for autonomous pickup from the frontier.

   work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.A briefed fix or small feature; blast radius bounded by the brief, tests exist.

   and removed

   needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

   on Oct 18, 2026
7. melodic-automation-lanes

   closed this as completedin #8102on Oct 19, 2026