Cua DocumentationIntegrations
HUD Evals
Use ComputerAgent with HUD for benchmarking and evaluation
The HUD integration allows you to use ComputerAgent with the HUD benchmarking framework, providing the same interface as existing HUD agents while leveraging ComputerAgent's capabilities.
Installation
pip install "cua-agent[hud]"
## or install hud-python directly
# pip install hud-python==0.2.10Usage
from agent.integrations.hud import run_job
from hud import load_taskset
from hud.taskset import TaskSet
import logging
# Load taskset
taskset = await load_taskset("OSWorld-Verified")
taskset = TaskSet(tasks=taskset[:10]) # limit to 10 tasks instead of all 370
# Run benchmark job
job = await run_job(
model="openai/computer-use-preview",
# model="anthropic/claude-3-5-sonnet-20241022",
# model="huggingface-local/HelloKKMe/GTA1-7B+openai/gpt-5",
task_or_taskset=taskset,
job_name="test-computeragent-job",
max_concurrent_tasks=5,
# add any extra ComputerAgent kwargs:
verbosity=logging.INFO, # Enable logging
# trajectory_dir=".." # Save trajectories locally
)
# Get results OR view them at app.hud.so
print(await job.get_analytics())
print(f"View results at: https://app.hud.so/jobs/{job.id}")Available Benchmarks:
- OSWorld-Verified - Benchmark on OSWorld tasks
See the HUD docs for more eval environments.