DeskTalk

DeskTalk is an open-source, AI-native desktop environment that operates entirely within a browser. It enables users to build, manage, and edit interactive applications by describing their needs in natural language, either through voice or text. The system is designed so that every aspect of the desktop, from window management to app creation, is orchestrated by AI through conversational input, removing the need for traditional menus or keyboard shortcuts.

A distinguishing feature of DeskTalk is its ability to generate fully interactive applications—referred to as LiveApps—on demand. Users can request an app, such as a project tracker, and the AI will generate and persist it in seconds, eliminating the need for app store downloads or installations. These LiveApps are saved to disk and can be launched from the dock. Editing is also conversational: users can focus on any app, describe desired changes, and the AI will read the code, make targeted edits, and reload the app instantly. All modifications are versioned with git, supporting undo and redo across sessions and ensuring that work is never lost.

The environment features a tile-based desktop with an actions bar, tiled window area, persistent AI panel, and a dock for quick launching. Windows can be opened, resized, focused, and minimized through either voice commands or mouse clicks. DeskTalk includes built-in apps such as Note, Terminal, File Explorer, and Text Editor, each implemented as an isolated MiniApp with its own backend and frontend. The system supports dynamic theming, including light and dark modes and an OKLCH-based color system that allows a single accent color to influence the entire palette.

DeskTalk integrates with over 15 AI providers, including Anthropic, OpenAI, Google, AWS Bedrock, Mistral, xAI, OpenRouter, and Ollama, allowing users to bring their own API keys or run models locally. Installation is streamlined, with options for npm or Docker deployment, and persistent storage for LiveApps, AI sessions, and configuration. DeskTalk is distributed under the MIT License and is free to use.