Skip to content

iOS: tap_point does not trigger SwiftUI toolbar navigationBarLeading Button #5

@rafiki270

Description

@rafiki270

Problem

tap_point hits the correct visual position of a SwiftUI toolbar button (verified by blue highlight in Instruments), but the button's action closure never fires.

Steps to Reproduce

  1. Build iOS app with SwiftUI NavigationStack + ToolbarItem(placement: .navigationBarLeading) containing a Button
  2. Connect AppReveal, get element list with get_elements
  3. Find the button element's frame (e.g., kitbaritemhost<baritemview>_1 at frame 20,69,36,30)
  4. Tap center: tap_point --args '{"x":38,"y":84}'
  5. success: true returned, but button action doesn't fire — view state unchanged

Expected

tapp_point coordinates should trigger the button's action.

Environment

  • iOS 26.2 (iPhone 17 Pro, 3x scale)
  • AppReveal via HTTP streamable-http transport
  • SwiftUI NavigationStack + toolbar buttons

Workaround

Tap coordinates need to be manually offset from reported element frames. Reported frame origin (20,69) doesn't match visual position.

Notes

  • tap_element with derived element IDs returns "Element not found" for SwiftUI toolbar items (kitbaritemhost)
  • get_elements only shows 4 container elements when fullScreenCover is presented (cannot see elements inside fullScreenCover)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions