Sponsor Suno AI Music arrow_forward
Subagent

Desktop Pilot

Autonomous desktop control agent using Claude's Computer Use API. Captures screenshots, executes mouse/keyboard actions, and runs multi-step GUI workflows in sandboxed environments.

Type
Subagent
GitHub stars
339
License
MIT
Repo last updated
Sep 24, 2026
Model
sonnet

What Desktop Pilot is

Desktop Pilot is a subagent published in the athola/claude-night-market repository on GitHub, which has about 339 stars. The repository describes itself as: “23 Claude Code plugins: TDD enforcement hooks, git/PR workflows, spec-driven development, code review, project lifecycle, fix-from-error, maintenance automation, context optimization, research, and multi-LLM delegation. 186 skills, 128 commands, 54 agents.”

A subagent is a specialist assistant that Claude can hand part of a task to. It is a markdown file whose frontmatter sets a name, a description that tells Claude when to delegate, and optionally the tools and model it may use; the body becomes the subagent's own system prompt.

Because a subagent works in its own context, it keeps the main conversation focused: Claude can send a narrow job, such as a review or a specialised analysis, to Desktop Pilot and get back a compact result.

It is set up to use these tools: Read, Bash, Glob, Write. Limiting tools is a good sign: the subagent can only do what those tools allow.

How to install Desktop Pilot

Claude Code

  1. Download desktop-pilot.md from the repository.
  2. Save it to ~/.claude/agents/ to use it in every project, or to .claude/agents/ inside one project to share it through version control.
  3. Claude Code watches these folders, so the subagent is usually available right away. Ask Claude to use it by name, or @-mention it to make sure it runs.

Claude Cowork

  1. Cowork loads subagents through plugins. If the repository is packaged as a plugin marketplace, add it under Customize → Plugins → Add marketplace and install the plugin that contains this subagent.
  2. Otherwise, bundle the file into your own plugin's agents/ folder and upload it from Customize → Plugins.

New to extending Cowork? Our plugins guide and Customize guide explain how skills, plugins, and connectors fit together.

Inside the source file

An excerpt from plugins/phantom/agents/desktop-pilot.md, shared under the repository's MIT license. Read the full file on GitHub.

Autonomous agent for controlling desktop environments through Claude's Computer Use API.

Capabilities

  • Take screenshots and analyze display content
  • Execute mouse clicks, typing, and keyboard shortcuts
  • Navigate applications, browsers, and desktop UIs
  • Run multi-step automation workflows with visual verification

Prerequisites

Check environment before proceeding:

cd plugins/phantom && uv run python -m phantom.cli --check

Required tools: xdotool, scrot (or imagemagick), xclip

Install if missing:

sudo apt install xdotool scrot xclip

Workflow

  1. Verify display environment is available
  2. Understand the user's task and break into steps
  3. For each step: a. Take a screenshot to see current state b. Determine the next action (click, type, key, scroll) c. Execute the action via phantom's display toolkit d. Take another screenshot to verify the result
  4. Report completion with final screenshot evidence

Usage

from phantom.display import DisplayConfig, DisplayToolkit
from phantom.loop import LoopConfig, run_loop
import os

result = run_loop(
    task="<user's task here>",
    api_key=os.environ["ANTHROPIC_API_KEY"],
    loop_config=LoopConfig(
        model="claude-sonnet-5",
        max_iterations=10,
    ),
)

Safety Rules

  • Never interact with banking, healthcare, or legal apps
  • Always verify actions with screenshots before proceeding
  • Respect the iteration cap to prevent runaway costs
  • Close sensitive applications before starting
  • Run in a sandboxed environment when possible

Before you install

  • Read the whole file first. Skills, commands, and subagents are instructions Claude will follow, so make sure they match what you want.
  • Check which tools, scripts, or MCP servers it uses. Local servers and scripts run with your permissions.
  • Try it in a test project or a copy of your files before pointing it at real work.
  • Pin the version you tested, and review changes before updating.
  • Watch for instructions that fetch web content or run shell commands; those are where prompt injection risks start. See our prompt injection guide.

FAQ

What is Desktop Pilot?

Desktop Pilot is a subagent for Claude Code and Claude Cowork from the athola/claude-night-market repository on GitHub. Autonomous desktop control agent using Claude's Computer Use API. Captures screenshots, executes mouse/keyboard actions, and runs multi-step GUI workflows in sandboxed environments.

How do I install Desktop Pilot in Claude Code?

Download desktop-pilot.md from the repository. Save it to ~/.claude/agents/ to use it in every project, or to .claude/agents/ inside one project to share it through version control. Claude Code watches these folders, so the subagent is usually available right away. Ask Claude to use it by name, or @-mention it to make sure it runs.

Can I use Desktop Pilot in Claude Cowork?

Cowork loads subagents through plugins. If the repository is packaged as a plugin marketplace, add it under Customize → Plugins → Add marketplace and install the plugin that contains this subagent. Otherwise, bundle the file into your own plugin's agents/ folder and upload it from Customize → Plugins.

Is Desktop Pilot safe to install?

It is a third-party community resource, not reviewed by Anthropic or this site. Read the source file first, check which tools and connectors it uses, and install only from sources you trust.

Similar resources

Browse all skills, subagents, and plugins →

Listing data comes from the public GitHub repository and was last checked in September 2026. Excerpts are © their authors and shared under MIT. This directory is independent and not affiliated with Anthropic or the resource's authors.