Data Attribution

EleutherAI 's Collections

Data Attribution

Evals

Deep Ignorance

Pythia Scaling Suite

PolyPythias

Quirky Models and Datasets

Pile-T5

Quirky Math (archive)

Pile-T5 T5x Checkpoints

Sparse Autoencoders

updated 4 days ago

Leave-1%-out retrain banks and datasets for training-data attribution: measured per-query loss changes, the ground truth for LDS.

Upvote

EleutherAI/LDS-retrain-bank-adamw-N4k-bs256

Viewer • Updated 12 days ago • 2k • 438
EleutherAI/LDS-retrain-bank-adamw-N8k-bs256

Viewer • Updated 12 days ago • 4.64k • 116
EleutherAI/LDS-retrain-bank-muon-N8k-bs256

Viewer • Updated 12 days ago • 2k • 184
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256

Viewer • Updated 12 days ago • 3.2k • 287
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.25

Viewer • Updated 12 days ago • 2.9k • 238
EleutherAI/LDS-retrain-bank-muon-N4k-bs256

Viewer • Updated 12 days ago • 2k • 117
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-ep4

Viewer • Updated 11 days ago • 4k • 285
EleutherAI/LDS-retrain-bank-adamw-N32k-bs256

Viewer • Updated 11 days ago • 4k • 71
EleutherAI/LDS-retrain-bank-muon-N16k-bs16

Viewer • Updated 11 days ago • 4k • 220
EleutherAI/LDS-retrain-bank-muon-N32k-bs256

Viewer • Updated 11 days ago • 4k • 207
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-gpt2-medium

Viewer • Updated 11 days ago • 4k • 234
EleutherAI/bergson-smollm2-lds-chunks

Viewer • Updated Jul 17 • 60.1k • 102
EleutherAI/bergson-smollm2-scaling

Viewer • Updated 17 days ago • 512k • 114
EleutherAI/LDS-retrain-bank-adamw-N16k-bs128

Viewer • Updated 13 days ago • 2k • 18
EleutherAI/LDS-retrain-bank-adamw-N16k-bs16

Viewer • Updated 13 days ago • 2k • 56
EleutherAI/LDS-retrain-bank-adamw-N16k-bs32

Viewer • Updated 14 days ago • 2k • 9
EleutherAI/LDS-retrain-bank-adamw-N16k-bs512

Viewer • Updated 13 days ago • 2k • 11
EleutherAI/LDS-retrain-bank-adamw-N16k-bs64

Viewer • Updated 15 days ago • 2k • 119
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-clip1.0

Viewer • Updated 13 days ago • 2.9k • 14
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.5

Viewer • Updated 13 days ago • 2.9k • 6
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.0

Viewer • Updated 13 days ago • 2.9k • 6
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.1

Viewer • Updated 13 days ago • 2.9k • 24
EleutherAI/LDS-retrain-bank-muon-N16k-bs128

Viewer • Updated 15 days ago • 2k • 351
EleutherAI/LDS-retrain-bank-muon-N16k-bs32

Viewer • Updated 14 days ago • 4k • 23
EleutherAI/LDS-retrain-bank-muon-N16k-bs64

Viewer • Updated 14 days ago • 2k • 11
EleutherAI/LDS-retrain-bank-muon-N16k-bs256

Viewer • Updated 13 days ago • 5.64k • 171
EleutherAI/LDS-retrain-bank-adamw-N64k-bs256

Viewer • Updated 8 days ago • 4.18k • 141
EleutherAI/bergson-wikitext-2-gpt2

Updated 7 days ago • 11
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1004

Viewer • Updated 7 days ago • 89.9k • 406
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1005

Viewer • Updated 7 days ago • 96.2k • 175
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1006

Viewer • Updated 7 days ago • 96.2k • 397
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1008

Viewer • Updated 7 days ago • 96.2k • 549
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1007

Viewer • Updated 7 days ago • 96.2k • 318
EleutherAI/LDS-retrain-bank-london16k-bs256-muon

Viewer • Updated 4 days ago • 2k • 56
EleutherAI/PARTIAL_LDS-retrain-bank-muon-N64k-bs256

Updated 4 days ago • 111
EleutherAI/PARTIAL_LDS-retrain-bank-gpt2medium-16k-bs32

Viewer • Updated 4 days ago • 1.3k • 186

Upvote