Skip to content

[Agent] main agent is very persistent about entering plan mode when creating hello world app #19312

@gundermanc

Description

@gundermanc

Repro:

  1. Ask Gemini CLI to create a hello world node js app.
  2. It then prompts you to enter plan mode.
  3. Cancel and repeat 2-3 times.

It alternates between being very persistent about entering plan mode and/or just proceeding to ask you the next step in your plan, as if it has entered plan mode.

Image

I suspect we have some prompt that is too firmly telling the agent it "MUST" enter plan mode when creating a new project and we're not giving it an out when the user rejects it.

I propose:

  • Adding a behavioral eval that checks 2-3 different "scopes" of project to enter plan mode for. IMO hello world app probably doesn't require it.
  • Adding a behavioral eval that checks that the user can reject entering plan mode and then run the same prompt again without getting prompted to enter plan mode again.

Metadata

Metadata

Assignees

Labels

status/need-triageIssues that need to be triaged by the triage automation.workstream-rollupLabel used to tag epics and features that are associated with one of the three primary workstreams🔒 maintainer only⛔ Do not contribute. Internal roadmap item.

Type

No fields configured for Task.

Projects

Status
Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions