184 GB
92,295 files
Updated 2 days ago
Name
Size
.ruff_cache
jobs
plan
probe
prompts
results
runs
scripts
specs
sweep
tasks
.bucketignore26 Bytes
xet
README.md968 Bytes
xet
README.md

Flint x ProgramBench (replicating Cohere Sec 4: solo PIV vs team PIV)

Mirror of the HF bucket cmpatino/flint-programbench. Everything specific to this experiment lives here, not in the swarmlab repo: the plan, prompts, specs, the task subset, the sweep and analysis scripts, probe logs and run outputs.

  • plan/cohere-sec4-piv-plan.md: the decided design (2026-10-22).
  • probe/: the H200 serving probe (probe.sh) and its two job logs (the first died on a huggingface_hub upgrade in the script; the second succeeded: server ready in ~106 s, tool calls parsed, 514 tok/s aggregate at 4 streams).
  • prompts/: the PIV guidance texts (solo, lead, worker), swarmlab's wording of the paper's regime.
  • specs/: the two experiment specs (solo-piv, team-piv).
  • tasks/: the balanced 30-task subset and the metadata table it was drawn from.
  • scripts/: sweep launcher and analysis.
  • runs/: fetched run directories and grades (one per task x condition).
Total size
184 GB
Files
92,295
Last updated
Oct 23
Pre-warmed CDN
US EU US EU

Contributors