Desktop Pilot
Autonomous desktop control agent using Claude's Computer Use API. Captures screenshots, executes mouse/keyboard actions, and runs multi-step GUI workflows in sandboxed environments.
- Type
- Subagent
- Repository
- athola/claude-night-market
- GitHub stars
- 339
- License
- MIT
- Repo last updated
- Sep 24, 2026
- Source file
- plugins/phantom/agents/desktop-pilot.md
- Model
- sonnet
What Desktop Pilot is
Desktop Pilot is a subagent published in the athola/claude-night-market repository on GitHub, which has about 339 stars. The repository describes itself as: “23 Claude Code plugins: TDD enforcement hooks, git/PR workflows, spec-driven development, code review, project lifecycle, fix-from-error, maintenance automation, context optimization, research, and multi-LLM delegation. 186 skills, 128 commands, 54 agents.”
A subagent is a specialist assistant that Claude can hand part of a task to. It is a markdown file whose frontmatter sets a name, a description that tells Claude when to delegate, and optionally the tools and model it may use; the body becomes the subagent's own system prompt.
Because a subagent works in its own context, it keeps the main conversation focused: Claude can send a narrow job, such as a review or a specialised analysis, to Desktop Pilot and get back a compact result.
It is set up to use these tools: Read, Bash, Glob, Write. Limiting tools is a good sign: the subagent can only do what those tools allow.
How to install Desktop Pilot
Claude Code
- Download desktop-pilot.md from the repository.
- Save it to ~/.claude/agents/ to use it in every project, or to .claude/agents/ inside one project to share it through version control.
- Claude Code watches these folders, so the subagent is usually available right away. Ask Claude to use it by name, or @-mention it to make sure it runs.
Claude Cowork
- Cowork loads subagents through plugins. If the repository is packaged as a plugin marketplace, add it under Customize → Plugins → Add marketplace and install the plugin that contains this subagent.
- Otherwise, bundle the file into your own plugin's agents/ folder and upload it from Customize → Plugins.
New to extending Cowork? Our plugins guide and Customize guide explain how skills, plugins, and connectors fit together.
Inside the source file
An excerpt from plugins/phantom/agents/desktop-pilot.md, shared under the repository's MIT license. Read the full file on GitHub.
Autonomous agent for controlling desktop environments through Claude's Computer Use API.
Capabilities
- Take screenshots and analyze display content
- Execute mouse clicks, typing, and keyboard shortcuts
- Navigate applications, browsers, and desktop UIs
- Run multi-step automation workflows with visual verification
Prerequisites
Check environment before proceeding:
cd plugins/phantom && uv run python -m phantom.cli --checkRequired tools: xdotool, scrot (or imagemagick), xclip
Install if missing:
sudo apt install xdotool scrot xclipWorkflow
- Verify display environment is available
- Understand the user's task and break into steps
- For each step: a. Take a screenshot to see current state b. Determine the next action (click, type, key, scroll) c. Execute the action via phantom's display toolkit d. Take another screenshot to verify the result
- Report completion with final screenshot evidence
Usage
from phantom.display import DisplayConfig, DisplayToolkit
from phantom.loop import LoopConfig, run_loop
import os
result = run_loop(
task="<user's task here>",
api_key=os.environ["ANTHROPIC_API_KEY"],
loop_config=LoopConfig(
model="claude-sonnet-5",
max_iterations=10,
),
)Safety Rules
- Never interact with banking, healthcare, or legal apps
- Always verify actions with screenshots before proceeding
- Respect the iteration cap to prevent runaway costs
- Close sensitive applications before starting
- Run in a sandboxed environment when possible
Before you install
- Read the whole file first. Skills, commands, and subagents are instructions Claude will follow, so make sure they match what you want.
- Check which tools, scripts, or MCP servers it uses. Local servers and scripts run with your permissions.
- Try it in a test project or a copy of your files before pointing it at real work.
- Pin the version you tested, and review changes before updating.
- Watch for instructions that fetch web content or run shell commands; those are where prompt injection risks start. See our prompt injection guide.
FAQ
What is Desktop Pilot?
Desktop Pilot is a subagent for Claude Code and Claude Cowork from the athola/claude-night-market repository on GitHub. Autonomous desktop control agent using Claude's Computer Use API. Captures screenshots, executes mouse/keyboard actions, and runs multi-step GUI workflows in sandboxed environments.
How do I install Desktop Pilot in Claude Code?
Download desktop-pilot.md from the repository. Save it to ~/.claude/agents/ to use it in every project, or to .claude/agents/ inside one project to share it through version control. Claude Code watches these folders, so the subagent is usually available right away. Ask Claude to use it by name, or @-mention it to make sure it runs.
Can I use Desktop Pilot in Claude Cowork?
Cowork loads subagents through plugins. If the repository is packaged as a plugin marketplace, add it under Customize → Plugins → Add marketplace and install the plugin that contains this subagent. Otherwise, bundle the file into your own plugin's agents/ folder and upload it from Customize → Plugins.
Is Desktop Pilot safe to install?
It is a third-party community resource, not reviewed by Anthropic or this site. Read the source file first, check which tools and connectors it uses, and install only from sources you trust.
Similar resources
- Workflow Recreate Agent Recreates the most recent command/session slice workflow from context, Subagent · athola/claude-night-market
- Additive Bias Defense Inverts burden of proof for code additions. Use when reviewing PRs, planning refactors, or running unbloat to challenge every addition's necessity. Skill · athola/claude-night-market
- Ai Hygiene Audit Audit codebase for AI-generated code quality issues (vibe coding, Tab bloat, slop) Slash Command · athola/claude-night-market
- Ai Hygiene Auditor Audit codebases for AI-generation warning signs: vibe coding patterns, agent psychosis indicators, slop artifacts, and Tab-completion bloat. Specialized complement to bloat-auditor. Subagent · athola/claude-night-market
- Discourse Scanner Scan community discourse channels (Hacker News, Lobsters, Reddit, tech blogs) for discussions and experience reports about a research topic. Returns findings with scores, key quotes, and contrarian views. Subagent · athola/claude-night-market
- Dependency Updater Dependency analysis and update agent for multi-ecosystem repositories. Subagent · athola/claude-night-market
- Doc Editor Documentation editor agent for polishing and improving content quality Subagent · athola/claude-night-market
- Craft Reviewer Evaluate generated text for craft depth across five dimensions - Subagent · athola/claude-night-market