Creating a Toolkit
This guide walks you through the complete process of creating a custom toolkit for Arcade - from initial setup to publishing on PyPI. You’ll build a simple arithmetic toolkit with operations like addition, subtraction, and multiplication. When creating or extending an Arcade toolkit, we make it easy to develop the tool alongside your agent, providing a pleasant local development experience. As your agent will be loading its available tools from the Arcade Engine, you can mix existing tools and your locally developed tool by following this guide. You’ll be running your local worker with the Arcade CLI and registering it with the Engine so that your agent can find and use your tool.
Prerequisites
Before starting, make sure you have:
- An Arcade account
- For this guide, we’ll use uv as our package manager.
Generate a toolkit template
Run the following command to start creating your toolkit:
uv tool run --from arcade-ai arcade new arithmeticEnter the optional information when prompted:
- Description: Provide a brief explanation of what your toolkit will do
- Author GitHub username and email: Your contact information
- Generate test and evaluation directories: Whether you want additional directories created for you
After completion, a directory with your toolkit name (arithmetic) will be created with the following structure:
arithmetic/
├── arcade_arithmetic/ # Core package directory
│ ├── __init__.py
│ └── tools/ # Directory for your tools
│ ├── __init__.py
│ └── hello.py # Example tool
├── evals/ # Evaluation directory
│ └── eval_arithmetic.py # Example evaluation file
├── tests/ # Test directory
│ ├── __init__.py
│ └── test_arithmetic.py # Example test file
├── pyproject.toml # uv project configuration
├── README.md
└── Makefile # uv helper commandsNavigate to your toolkit directory:
cd arithmeticSet up the development environment
An active virtual environment for your shell(s) is required to run the local development commands.
uv venv --seed -p 3.13Install dependencies and pre-commit hooks:
make installThis installs all dependencies specified in pyproject.toml, pre-commit hooks for code quality, and your toolkit in development mode.
The Makefile provides several helpful commands:
build- Build wheel file using uvbump-version- Bump the version in the pyproject.toml file by a patch versioncheck- Run code quality toolsclean-build- Clean build artifactscoverage- Generate coverage reportinstall- Install the uv environment and install all packages with dependenciesinstall-local- Install Arcade components (CLI, TDK, etc.) from source in editable mode. Only use this when you are developing against the latest unreleased code from the arcade-ai repo main branch instead of the published packagestest- Test the code with pytest
Activate the environment with:
source .venv/bin/activateor
uv runDefine your tools
Create a Python file for your tools in the arcade_arithmetic/tools directory.
The following example shows a simple math toolkit with three tools: add, subtract, and multiply:
# arcade_arithmetic/tools/operations.py
from typing import Annotated
from arcade_tdk import tool
@tool
def add(
a: Annotated[int, "The first number"],
b: Annotated[int, "The second number"]
) -> Annotated[int, "The sum of the two numbers"]:
"""
Add two numbers together
Examples:
add(3, 4) -> 7
add(-1, 5) -> 4
"""
return a + b
@tool
def subtract(
a: Annotated[int, "The first number"],
b: Annotated[int, "The second number"]
) -> Annotated[int, "The difference of the two numbers"]:
"""
Subtract the second number from the first
Examples:
subtract(10, 4) -> 6
subtract(5, 7) -> -2
"""
return a - b
@tool
def multiply(
a: Annotated[int, "The first number"],
b: Annotated[int, "The second number"]
) -> Annotated[int, "The product of the two numbers"]:
"""
Multiply two numbers together
Examples:
multiply(3, 4) -> 12
multiply(-2, 5) -> -10
"""
return a * bUpdate the package initialization files to expose your tools:
# arcade_arithmetic/tools/__init__.py
from arcade_arithmetic.tools.operations import add, multiply, subtract
__all__ = ["add", "multiply", "subtract"]# arcade_arithmetic/__init__.py
from arcade_arithmetic.tools import add, multiply, subtract
__all__ = ["add", "multiply", "subtract"]Test your toolkit
Write tests for your tools in the tests directory:
# tests/test_operations.py
import pytest
from arcade_arithmetic.tools.operations import add, multiply, subtract
def test_add():
assert add(3, 4) == 7
assert add(-1, 5) == 4
assert add(0, 0) == 0
def test_subtract():
assert subtract(10, 4) == 6
assert subtract(5, 7) == -2
assert subtract(0, 0) == 0
def test_multiply():
assert multiply(3, 4) == 12
assert multiply(-2, 5) == -10
assert multiply(0, 5) == 0Run the tests:
make testCheck code quality:
make checkGenerate a coverage report (optional):
make coverageVerify local installation
Your toolkit should already be installed locally from the make install command. Verify it’s properly registered:
arcade show --localYou should see your toolkit listed in the output.
Test your tools locally
Serve your toolkit locally with the Arcade CLI:
arcade serveYou can use the --reload flag to automatically reload the server when you make changes to your toolkit:
arcade serve --reloadVisit http://localhost:8002/worker/health to see that your worker is running.
Connect your toolkit to the Arcade Engine
In another terminal, use a service like ngrok, tailscale, or cloudflare to give your local worker a public URL.
ngrok http 8002Then in your Arcade dashboard:
- Navigate to the Workers page.
- Click Add Worker.
- Fill in the form with the following values:
- ID:
my-arithmetic-worker - Worker Type:
Arcade - URL: your public URL from ngrok, tailscale, or cloudflare
- Secret:
dev - Timeout and Retry: can be left at default values
- ID:
- Click Create.
Now, in the Playground, you can see your tools in action.
Deploy your toolkit to the Arcade Engine
Alternatively, you can deploy your toolkit to Arcade’s cloud instead of tunneling to it locally.
Find the worker.toml file in your toolkit’s root directory (where you ran uv tool run --from arcade-ai arcade new arithmetic):
[[worker]]
[worker.config]
id = "demo-worker" # Choose a unique ID
enabled = true
timeout = 30
retries = 3
secret = "<your-secret>" # This is randomly generated for you by `uv tool run --from arcade-ai arcade new arithmetic`
[worker.local_source]
packages = ["./arithmetic"] # Path to your toolkit directorySee Configuring Arcade Deploy for more configuration options.
From the root of your toolkit, deploy your toolkit to Arcade’s cloud with:
This may take a while your first time.
arcade deployVerify the deployment:
arcade worker listPackage and publish to PyPI
Clean any previous build artifacts:
make clean-buildIf you’re updating an existing package, bump the version:
make bump-versionCreate a comprehensive README.md file that explains your toolkit’s purpose, installation, and usage.
Build your package:
make buildPublish to PyPI:
uv publish --token YOUR_PYPI_TOKEN_HEREUsing your published toolkit
Now that your toolkit is published, you can use it in any Arcade application:
from arcadepy import Arcade
# Initialize the Arcade client
client = Arcade()
# Use your Tools
response = client.tools.execute(
tool_name="Arithmetic.Add",
input={
"a": 12,
"b": 34
},
)
print(response.output.value)Ongoing toolkit maintenance
As you continue to develop your toolkit, use these Makefile commands to maintain it:
make check- Run code quality checks before committing changesmake test- Run tests to ensure your changes don’t break existing functionalitymake coverage- Monitor test coverage as you add new featuresmake bump-version- Update the version when releasing new changesmake build- Build new distribution packagesmake clean-build- Clean up build artifacts when needed
Next steps
- Add more tools: Expand your toolkit with more complex operations
- Add authentication: Learn how to create tools with authentication
- Add secrets: Learn how to create tools with secrets
- Evaluate your tools: Explore how to evaluate tool performance
- Set up CI/CD: Automate testing and deployment with continuous integration