The Dataset Viewer has been disabled on this dataset.
simreadybench CodeBuddy runs (MuJoCo and Isaac)
Generation runs of the sim-ready benchmark with the CodeBuddy Code CLI: 3075 runs, each budget a fresh session, budgets 900/1800/2700 s.
| engine | items | models | runs |
|---|---|---|---|
| MuJoCo | 111 | Kimi K3.1 Pro, GLM 5.3 Flash, DeepSeek V4.1 Flash, Hunyuan 4 (hy4std), Hunyuan 4 preview (hy4-preview) |
5 x 333 = 1665 |
| Isaac Sim | 111 | Kimi K3.1 Pro, GLM 5.3 Flash, DeepSeek V4.1 Flash, Hunyuan 4 (hy4std) |
4 x 333 = 1332 |
| Isaac Sim | 78 of 111 | Hunyuan 4 preview (hy4-preview), stopped when Hunyuan 4 replaced it |
78 |
Layout: <track>/<engine>/<item>/<run_id>/ (track = scenes, objects or demos) with run.json, generation.jsonl (the CLI's stream-json log), submitted_prompt.txt, input/, output/. The model of a run is model_id in its run.json.
Not evaluated yet. Model ids are given without deployment suffixes and some host-specific strings and credentials are redacted. The Hub refuses paths containing /x00, so files named x00* are stored as _x00*.
The Claude Code (Claude Opus 5.5) and Codex (GPT-6.1 Sol) runs of the same benchmark are in FlippyDora/simreadybench-claude-codex-runs.
- Downloads last month
- 180