Skip to content

[Bug]: iOS emulator AX command is disabled despite serve-sim support #9923

Closed

Description

@5Hyeons

Operating system

macOS

Orca version

1.4.150-rc.0 (main at 7304776c2)

Details

Short summary

orca emulator ax rejects iOS Simulator targets even though the bundled serve-sim helper exposes an accessibility tree endpoint for the active session.

What happened?

The command fails before querying the helper:

{
  "ok": false,
  "error": {
    "code": "emulator_unsupported",
    "message": "accessibilityTree is not supported by the ios emulator backend"
  }
}

This leaves agent-driven iOS emulator control without structured UI discovery, so agents must rely primarily on screenshot-based coordinate estimation.

How can we reproduce it?

  1. Run Orca from main on macOS.
  2. Attach an iOS Simulator to a worktree with orca-dev emulator attach <udid> --worktree <selector> --json.
  3. Run orca-dev emulator ax --device <udid> --worktree <selector> --json.
  4. Observe exit code 1 and emulator_unsupported.

Expected behavior

Return the raw iOS accessibility tree for the active Simulator session, as already exposed by serve-sim's /ax endpoint.

Root cause

  • The iOS backend advertises accessibilityTree: false and has no explicit AX implementation.
  • Detached session parsing does not derive the /ax endpoint when the helper omits axUrl.
  • The runtime does not route the active worktree session's AX endpoint to the backend.

The Android accessibility path is unaffected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

os:macosIssues affecting macOS

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions