Benchmark datasets

Preprocessed, canonically-laid-out copies of the datasets used by this repo's BenchmarkEvaluator (see docs/benchmark/evaluator_quickstart.md), packaged for direct download instead of re-running every scripts/download/ + scripts/preprocess/ step yourself.

Layout: each dataset scene is stored as one uncompressed <Task>/<dataset>/<scene>.tar (the raw tree is ~900k files). After downloading, extract everything in place with the bundled script:

huggingface-cli download Bluefish2333/benchmark --repo-type dataset --local-dir /path/to/benchmark_root
python /path/to/benchmark_root/extract_benchmark_archives.py /path/to/benchmark_root --delete

Every dataset folder below is redistributed under its own original source's license -- see that folder's own LICENSE_NOTICE.md. This repository's own license does not override those terms.

Included datasets

Task	Dataset	Scenes	License status	Source(s)	Data
MonoDepth	marigold	4	unconfirmed	NYU Depth V2, KITTI (depth selection / raw data), ETH3D, DIODE, ScanNet	packaged here (without scannet; see LICENSE_NOTICE.md)
MonoDepth	aerialmetric	3	unconfirmed	AerialMetric-Decoupled, AerialMetric-Oblique (test split), AerialMetric-Wild	packaged here
MonoDepth	hammer	1	safe	HAMMER (Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regression)	packaged here
MonoDepth	ibims1	1	safe	iBims-1 (independent Benchmark images and matched scans, version 1)	packaged here
MonoDepth	spring	1	safe	Spring	packaged here
MonoDepth	synth4k	5	unconfirmed	Synth4K (InfiniDepth game-captured 4K benchmark)	packaged here
VideoDepth	sintel	23	unconfirmed	MPI-Sintel (depth extension)	packaged here
VideoDepth	bonn	26	safe	Bonn RGB-D Dynamic Dataset	packaged here
VideoDepth	dycheck	12	safe	DyCheck (iPhone dataset, MegaSaM-distributed evaluation archive)	packaged here
VideoDepth	kitti	13	safe	KITTI (depth selection / raw data)	packaged here
SfM	eth3d	13	safe	ETH3D	packaged here
SfM	tanks_and_temples	6	safe	Tanks and Temples	packaged here
SfM	imc	8	unconfirmed	Image Matching Challenge (IMW2020) Phototourism TestData	packaged here
MVRecon	7scenes	7	safe	Microsoft 7-Scenes	packaged here
MVRecon	eth3d	13	safe	ETH3D	see SfM/eth3d/
MVRecon	tanks_and_temples	6	safe	Tanks and Temples	see SfM/tanks_and_temples/
MVRecon	dtu	15	unconfirmed	DTU MVS / Robot Image Data Sets	packaged here
MVRecon	scannetpp	20	safe	ScanNet++	packaged here
MVRecon	hiroom	30	safe	HiRoom (via DA3-BENCH)	packaged here
SLAM	7scenes	18	safe	Microsoft 7-Scenes	packaged here
SfM	dtu	15	unconfirmed	DTU MVS / Robot Image Data Sets	see MVRecon/dtu/
SfM	scannetpp	20	safe	ScanNet++	see MVRecon/scannetpp/
SfM	hiroom	30	safe	HiRoom (via DA3-BENCH)	see MVRecon/hiroom/
SfM	texturepoorsfm	30	unconfirmed	TexturePoorSfM	packaged here
MVRecon	nrgbd	9	safe	Neural RGB-D Surface Reconstruction dataset	packaged here
SLAM	tum_dynamics	9	safe	TUM RGB-D SLAM Dataset (Dynamic Objects category)	packaged here
SLAM	oxford_spires	10	safe	The Oxford Spires Dataset	packaged here
SLAM	vbr	7	unconfirmed	VBR: A Vision Benchmark in Rome	packaged here
SLAM	kitti_odometry	11	safe	KITTI Odometry	packaged here
MonoDepth	spatialarena	0	safe	SpatialArena (the benchmark's own handheld 3-camera LiDAR rig captures)	packaged here
VideoDepth	spatialarena	0	safe	SpatialArena (the benchmark's own handheld 3-camera LiDAR rig captures)	packaged here
MVRecon	spatialarena	0	safe	SpatialArena (the benchmark's own handheld 3-camera LiDAR rig captures)	packaged here
SfM	spatialarena	0	safe	SpatialArena (the benchmark's own handheld 3-camera LiDAR rig captures)	packaged here
SLAM	spatialarena	0	safe	SpatialArena (the benchmark's own handheld 3-camera LiDAR rig captures)	packaged here