Repository navigation
Add READMEs to featured environments #725
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| # Browser Use | ||
|
|
||
| A visual web-research environment backed by a real Chromium browser. Agents can | ||
| inspect screenshots, navigate, click, scroll, and use the browser's developer | ||
| protocol without leaving the allowed website. | ||
|
|
||
| The featured task asks the agent to inspect rental photos and count the chairs | ||
| at a specific kitchen table. Grading checks both the exact answer and whether | ||
| the agent cited screenshot evidence that actually showed the kitchen. | ||
|
|
||
| The environment exposes: | ||
|
|
||
| - `cdp`: direct browser control for compatible agents | ||
| - `mcp`: screenshot and browser-interaction tools | ||
|
|
||
| Deploy from this directory with: | ||
|
|
||
| ```bash | ||
| hud deploy | ||
| ``` | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,3 +1,3 @@ | ||
| hud[agents]==0.6.19 | ||
| hud[agents]==0.6.20 | ||
| playwright==1.63.0 | ||
| uvicorn==0.54.0 |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,21 @@ | ||
| # File Analysis | ||
|
|
||
| A document-analysis environment for tasks built from prompts, uploaded files, | ||
| and weighted grading criteria. Files are staged in an isolated workspace where | ||
| the agent can inspect them with shell tools and write a final report. | ||
|
|
||
| The featured task is a supplier-payment reconciliation. It combines invoices, | ||
| bank payments, receiving records, and vendor terms, then grades the resulting | ||
| report for correct calculations, evidence, and recommended follow-up. | ||
|
|
||
| The environment provides: | ||
|
|
||
| - an isolated shell workspace with network access disabled | ||
| - file tracking for the agent's report | ||
| - criteria-based grading with an LLM judge | ||
|
|
||
| Deploy from this directory with: | ||
|
|
||
| ```bash | ||
| hud deploy | ||
| ``` |
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| # Flask Coding | ||
|
|
||
| A coding environment that gives the agent an isolated Flask repository and | ||
| grades its changes with hidden tests. Each task starts from a clean git | ||
| baseline, exposes only the working tree to the agent, and applies the hidden | ||
| test patch after the agent finishes. | ||
|
|
||
| The featured task asks the agent to add binary-file loading support to | ||
| `flask.Config.from_file` while preserving the existing text and error-handling | ||
| behavior. The score comes from targeted fail-to-pass and regression tests. | ||
|
|
||
| The workspace blocks network access and runs the agent as an unprivileged user. | ||
| Existing runs remain reproducible because each task pins its repository | ||
| baseline and test contract. | ||
|
|
||
| Deploy from this directory with: | ||
|
|
||
| ```bash | ||
| hud deploy | ||
| ``` |
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| # Libbet | ||
|
|
||
| A visual Game Boy environment built from the freely licensed homebrew puzzle | ||
| game *Libbet and the Magic Floor*. Agents see the current screen and play with | ||
| MCP tools for the directional pad, buttons, waiting, and screenshots. | ||
|
|
||
| The emulator advances only when a tool is called, so the game stays paused | ||
| while the agent reasons. The featured task gives the agent 40 action steps to | ||
| explore the game. | ||
|
|
||
| Scoring rewards visually distinct progress discovered during play rather than | ||
| requiring a particular level completion. Screenshots and scoring details are | ||
| recorded in the trace. | ||
|
|
||
| Deploy from this directory with: | ||
|
|
||
| ```bash | ||
| hud deploy | ||
| ``` |
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -22,3 +22,4 @@ examples/ | |
| docs/ | ||
| run_vla.py | ||
| *.md | ||
| !README.md | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| # Robot Gripper | ||
|
|
||
| A tabletop robotics environment powered by a Newton physics simulation. Agents | ||
| control a gripper through MCP tools, inspect rendered views and simulator state, | ||
| and receive rewards from the resulting physical state. | ||
|
|
||
| The environment includes tasks for opening a drawer, lifting and moving an | ||
| object, and maintaining a force-controlled grasp. The featured task asks the | ||
| agent to pick up a mug within a 40-step budget. | ||
|
|
||
| Grading measures continuous progress as well as task completion, so partial | ||
| movement receives a proportional score while reaching the target earns the | ||
| success bonus. | ||
|
|
||
| Deploy from this directory with: | ||
|
|
||
| ```bash | ||
| hud deploy | ||
| ``` |
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Uh oh!
There was an error while loading. Please reload this page.