Skip to content

feat(media): Select text in images with Live Text - #2797

Draft
karlitschek wants to merge 1 commit into
feat/haptics-reactions-widgets-call-adaptationfrom
feat/media-live-text
Draft

karlitschek wants to merge 1 commit into
feat/haptics-reactions-widgets-call-adaptationfrom
feat/media-live-text

Conversation

@karlitschek

Copy link
Copy Markdown
Member

Images in the media viewer are analyzed on the device with VisionKit. Text can be selected and copied, phone numbers, addresses, links and QR codes can be used directly by long pressing them. Only on supported devices. The Live Text corner button is hidden, as it would move with the image when zooming.

Notes

Testing

  • App and all extensions build for the simulator (Xcode 27.1)
  • The combined branch with all features also builds in Release for generic/platform=iOS (iPhone, iPad, Mac "Designed for iPad") and for watchOS hardware
  • Not yet tried by hand with a real account and device, hence the draft.

馃 Generated with Claude Code

Images opened in the media viewer are analyzed on the device with
VisionKit. Text can then be selected and copied, and phone numbers,
addresses, links and QR codes can be used directly, by long pressing
them.

The analysis only runs on devices supporting it. The Live Text button
in the corner is hidden, as it would move with the image when zooming.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Frank Karlitschek <karlitschek@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant