Computer Use API Documentation

Anthropic has introduced a beta feature called "computer use" with its Claude 3.5 Sonnet model, enabling interaction with a computer desktop environment. This feature allows Claude to perform tasks such as saving files or executing commands, but it comes with unique risks, particularly when accessing the internet. Users are advised to implement safety measures, including using a virtual machine with limited privileges, avoiding sensitive data access, and restricting internet access to a whitelist of domains. Additionally, human confirmation is recommended for actions that could have significant real-world consequences. The implementation involves a reference model that includes a web interface and an agent loop for task execution. Users can optimize Claude's performance by providing clear instructions and using specific prompts for tasks. The system generates a specific prompt for computer use, ensuring that Claude operates within a controlled environment. The tools available for Claude include a computer tool for desktop interaction, a text editor for file manipulation, and a bash tool for command execution. As this is a beta feature, users should be aware that tool definitions may change and are encouraged to provide feedback on their experiences.

- Claude 3.5 Sonnet model can interact with desktop environments.

- Unique risks are associated with the computer use feature, especially online.

- Safety measures include using virtual machines and limiting data access.

- Clear instructions can enhance Claude's task performance.

- The feature is currently in beta, with potential changes to tool definitions.