Run Workspace outside Cloudflare Workers and add X11 desktop container & GUI automation

[NannaOlympicBroadcast]

Summary

Allow @cloudflare/computer (Workspace, SQLite storage, execution backends, and agent tools) to run standalone in plain Node.js without workerd or a Durable Object binding, and add an X11 desktop container (Dockerfile.desktop) plus end-to-end GUI automation across @cloudflare/computer-rpc, @cloudflare/computerd, workspace.desktop, and @cloudflare/computer/tools/*.

Reference branch / patch: NannaOlympicBroadcast:feat/standalone-and-desktop

Background and motivation

1. Running outside Cloudflare Workers: Today, importing @cloudflare/computer in plain Node.js fails immediately because several modules statically import "cloudflare:workers" (WorkerEntrypoint), requiring callers outside workerd to register a custom --import module loader hook. Furthermore, new Workspace({ storage }) requires a Durable Object DurableObjectStorage handle, and container backends assume a Cloudflare Containers binding.
2. Desktop containers and GUI automation: Agents frequently need to interact with graphical applications (browsers, terminals, desktop apps) alongside shell commands and the FUSE-mounted /workspace filesystem. computerd currently exposes shell (ExecRPC) and sync (SyncRPC), but has no display server lifecycle management or GUI input/screenshot RPC surface.

Goals

• Resolve WorkerEntrypoint dynamically (process.getBuiltinModule("cloudflare:workers") when running in workerd, with a lightweight fallback class in Node.js) so @cloudflare/computer imports cleanly in Node.js 22+ with no loader hooks.
• Provide NodeSQLiteStorage backed by Node's built-in node:sqlite (DatabaseSync), and make WorkspaceOptions.storage optional (defaulting to :memory: or accepting a database file path string).
• Allow getWorkspace(ws) to accept a standalone Workspace instance directly.
• Add ComputerdBackend and DockerContainerBackend under @cloudflare/computer/backends/computerd so a Workspace can connect to any reachable computerd HTTP/WebSocket endpoint or manage a local Docker container.
• Extend ComputerRPC with a desktop sub-service (DesktopRPC / DesktopRPCServer) supporting status, start, stop, screenshot (PNG/JPEG + crop region), mouse click / doubleClick / tripleClick / rightClick / middleClick / mouseDown / mouseUp / move / drag / scroll, keyboard type / key, cursorPosition, screenSize, windows, focusWindow, clipboardRead / clipboardWrite, and wait.
• Implement DesktopController in @cloudflare/computerd to supervise Xvfb, fluxbox, x11vnc, and websockify/noVNC and dispatch X11 operations (import/scrot/ffmpeg, xdotool, wmctrl, xclip/xsel), along with packages/computerd/Dockerfile.desktop.
• Expose workspace.desktop (WorkspaceDesktop) and createDesktopTool / desktop: true in createAITools, createPiTools, and createTanStackTools.

Example

import { Workspace } from "@cloudflare/computer";
import { DockerContainerBackend } from "@cloudflare/computer/backends/computerd";
import { createAITools } from "@cloudflare/computer/tools/ai-sdk";

const ws = new Workspace({
  storage: "./workspace.db",
  backends: [
    new DockerContainerBackend({
      image: "computerd-desktop:latest",
      desktop: { resolution: "1280x720x24", hostNoVncPort: 6080 },
      dockerArgs: ["--privileged"],
    }),
  ],
});

await ws.fs.writeFile("/workspace/hello.txt", "Hello from host\n");
await ws.desktop.move({ x: 320, y: 240 });
await ws.desktop.click({ x: 320, y: 240, button: "left" });
const shot = await ws.desktop.screenshot({ format: "png" });

const tools = createAITools({ workspace: ws, desktop: true });
await ws.close();

Verification and compatibility

• Compatibility: All existing Durable Object, WorkerEntrypoint, ContainerBackend, and WorkerShellBackend APIs remain backward-compatible. NodeSQLiteStorage lazy-loads node:sqlite via process.getBuiltinModule("node:sqlite") so workerd bundles never resolve node:sqlite.
• Tests:
  • npm test --workspace @cloudflare/computer-rpc -- tests/desktop-wire.test.ts (capnweb wire tests for DesktopRPC)
  • npm test --workspace @cloudflare/computerd -- src/desktop/controller.test.ts (DesktopController lifecycle and X11 command tests)
  • npm test --workspace @cloudflare/computer -- src/standalone.test.ts (standalone NodeSQLiteStorage, ComputerdBackend, end-to-end Docker desktop container test with FUSE sync + noVNC + xterm GUI window focus/typing + PNG screenshot, and desktop tool tests)
  • npm run check (oxlint, oxfmt --check, and sherif) exits 0.