Remote access: web client and phone access through Muster Server, with needs-you notifications #326

Activity

1. Dkm0315

   added

   type:featureNew feature or requestNew feature or request

   on Oct 8, 2026
2. Dkm0315 commented on Nov 10, 2026

   

   Dkm0315

   on Nov 10, 2026

   ContributorAuthor

   More actions

   Scope added 2026-11-10: a complete mobile app (iOS and Android), not only a web client.

   • Pair a phone with the desktop app (QR code), reached through Muster Server or a relay; end-to-end encrypted; works away from the home network.
   • Chats list, open a chat with its live stream, send messages and steer, attach photos and files.
   • A needs-you feed and push notifications: approvals, questions, failures, finished runs; answer them in place.
   • Start a new chat in a folder or project on the desktop; pick provider and model.
   • Projects: tasks, runs and Inbox (read and act).
   • Dictation in the composer (shares Composer: dictation (speak your prompt) #840).
   • Rich replies render: Markdown, code, diffs, Mermaid, charts, maths, pages.
   • Phone-safe access: read-only by default per device, revoke a device from desktop Settings.
   • Ships through TestFlight/Play internal testing first.
3. Dkm0315

   added 11 commits that reference this issue on Nov 10, 2026

   test(mobile): red: spec clause 23 and phase 1 workflow tests for phon…

   ...

   f470cd4

   feat(mobile): phone pairing, Noise channel, device registry and dev r…

   ...

   67196f4

   fix(server): phone pairing commands are desktop only on Muster Server

   ...

   a0874ac

   wip(mobile): packages/mobile scaffold (Expo 58, RN 0.88, jest-expo), …

   ...

   5cec349

   test(mobile): red: phone app screen and crypto interop tests (MUS-SPE…

   ...

   262ff8a

   feat(mobile): phone app screens and noble crypto (green for MUS-SPEC-…

   ...

   0040b76

   feat(mobile): Expo Router app, secure-store link with reconnect, QR s…

   ...

   8786fe2

   test(mobile): red: Settings › Integrations › Phone DOM suite (MUS-SPE…

   ...

   0c3d301

   feat(mobile): Settings › Integrations › Phone: relay, pairing QR, pai…

   ...

   99be601

   docs(mobile): note that Muster Server does not pair phones until phase 3

   ...

   ebae66e

   fix(mobile): Phone settings ignore an empty status from a stub host

   ...

   a05a1fc
4. Dkm0315 commented on Nov 12, 2026

   

   Dkm0315

   on Nov 12, 2026

   Last edited by Dkm0315

   ContributorAuthor

   More actions

   Scope decided 2026-11-12: the phone app is the full desktop experience in your pocket, on phones and tablets, iOS and Android. Smooth, animated, no lag while a reply streams.

   Built (phases 1 and 2, #862 and #864):

   • Pair by QR, end-to-end encrypted relay, chats, live stream, send, steer, approve, answer questions, Needs-you feed, read-only or can-act per device
   • New chat (folder or project, provider, model), photos and files, direct connection on the same network

   Still to build, in order:

   • Review diffs and changed files of a chat; keep or undo changes (Mobile app phase 5: v3 design, diff review with keep and undo (#326) #879)
   • File browser and file viewer with syntax highlighting
   • Screenshots, images and files an agent produces: inline, gallery, save and share
   • Rich replies: Markdown, code, Mermaid, charts, maths
   • Git actions: status, commit, push, open a pull request
   • Terminal: output of running commands, and send input
   • Switch model and access mode mid-chat
   • Several computers in one app (Mobile app phase 4: several computers, offline, rich replies, tablets (#326) #867)
   • Offline history: last known state opens without a connection (Mobile app phase 4: several computers, offline, rich replies, tablets (#326) #867)
   • Push notifications for approvals, questions, failures and finished runs
   • Tablet layouts (two-pane) and landscape
   • Motion and performance pass: 60 fps lists and streaming, native transitions, measured on a mid-range Android phone
   • Projects: tasks, runs and Inbox
   • Dictation
   • Hosted relay by default, self-hosting as an option
   • Start a chat from a GitHub issue
   • Realtime voice conversation with the agent (beyond dictation)
   • Live screenshots and previews of what the agent's app or browser shows right now
   • Connection without setup: QR pairing through the hosted relay; LAN direct and private networks such as Tailscale also work
   • Polished UI and UX on every screen (new screen designs, motion, haptics, empty, loading and error states), reviewed against the screen designs before each phase merges
   • Store builds: TestFlight and Play internal testing, then the stores

   Progress 2026-11-15: phase 3 (#865) brought delta streaming, a virtualized chat, a keyboard-sticky composer, heartbeat, the approved look, haptics and the security leftovers. Phase 4 (#867) brought several computers, an offline cache and outbox, native Markdown (diagram cards still show source), and tablet width classes with landscape (the foldable hinge split is still to come). Phase 5 is building: the v3 design across the app, then diff review with keep and undo.

   Progress: phase 5 (#879) brought the v3 design across the app, plus changed files and a diff with keep and undo per file and per change, and Stop. Phase 6 is building: files, git, terminal, and switching model and access mid-chat.
5. Dkm0315

   added a commit that references this issue on Nov 12, 2026

   mobile: a replayed first session message opens no lasting session (#326)

   ...

   85230df
6. 28 remaining items

   Load more
7. Dkm0315

   added 15 commits that reference this issue on Nov 14, 2026

   Pin that a message or steer sent again with its request id is answere…

   ...

   0cbdd61

   Pin that a message or steer sent again with its request id is answere…

   ...

   a7ccfdb

   Mobile app phase 4: several computers, offline, rich replies, tablets (…

   ...

   29c7f03

   Mobile phase 5: changed files, paged highlighted diffs, keep, undo an…

   ...

   2329983

   Mobile phase 5: red tests for the v3 restyle (24A-24I) (#326)

   552559a

   Mobile phase 5: the v3 restyle - tokens, glass tab bar, two-line chat…

   ...

   4339d03

   Mobile phase 5: red tests for the changes list and the inline and spl…

   ...

   67b043b

   Mobile phase 5: changes list and inline and split diff with keep and …

   ...

   a738c51

   Mobile phase 5: changelog line and design notes (#326)

   22a96e0

   Mobile app phase 5: v3 design, diff review with keep and undo (#326) (#…

   ...

   4c7336b

   Mobile phase 6: browse and read the chat's folder, Git status, commit…

   ...

   4fde440

   Mobile phase 6: red tests for the files screen, file viewer, source c…

   ...

   5b23ece

   Mobile phase 6: files screen, file viewer, source control, switch bra…

   ...

   be2c347

   Mobile phase 6: spec cases 25L-25N and red tests for the terminal on …

   ...

   2a2a59c

   Mobile phase 6: the chat's terminals over the phone bridge, coalesced…

   ...

   d5002f5