Resources HuggingFaceFW/fineweb Viewer • Updated Jul 11, 2025 • 52.5B • 1.07M • 2.86k CohereLabs/aya_dataset Viewer • Updated Apr 15, 2025 • 206k • 13.3k • 351 CohereLabs/tiny-aya-global Text Generation • 3B • Updated May 1 • 22.6k • • 154
PolyGloss GlossLM v2 lecslab/polygloss-corpus Viewer • Updated Dec 11, 2025 • 353k • 215 • 4 lecslab/polygloss-byt5-interleaved-2025-12-28 0.6B • Updated Feb 21 • 280 lecslab/polygloss-byt5-multitask-2025-12-28 Updated Dec 29, 2025 • 8 lecslab/polygloss-byt5-concat-2025-12-28 Updated Dec 29, 2025 • 7
Spec Decoding lecslab/biling_ber Viewer • Updated May 1 • 354k • 229 lecslab/biling_chr Viewer • Updated May 1 • 10.9k • 106 lecslab/biling_haw Viewer • Updated May 1 • 121 • 64 lecslab/biling_ibo Viewer • Updated May 1 • 1.75k • 167
GlossLM Multilingual IGT corpora and pretrained models lecslab/glosslm 0.6B • Updated Nov 4, 2024 • 28 • 3 lecslab/glosslm-unimorph-st_unseg_only 0.6B • Updated Jun 13, 2024 • 2 lecslab/glosslm-corpus Viewer • Updated Nov 4, 2024 • 451k • 52 • 2 lecslab/glosslm-corpus-split Viewer • Updated Mar 10, 2024 • 556k • 479
Resources HuggingFaceFW/fineweb Viewer • Updated Jul 11, 2025 • 52.5B • 1.07M • 2.86k CohereLabs/aya_dataset Viewer • Updated Apr 15, 2025 • 206k • 13.3k • 351 CohereLabs/tiny-aya-global Text Generation • 3B • Updated May 1 • 22.6k • • 154
Spec Decoding lecslab/biling_ber Viewer • Updated May 1 • 354k • 229 lecslab/biling_chr Viewer • Updated May 1 • 10.9k • 106 lecslab/biling_haw Viewer • Updated May 1 • 121 • 64 lecslab/biling_ibo Viewer • Updated May 1 • 1.75k • 167
PolyGloss GlossLM v2 lecslab/polygloss-corpus Viewer • Updated Dec 11, 2025 • 353k • 215 • 4 lecslab/polygloss-byt5-interleaved-2025-12-28 0.6B • Updated Feb 21 • 280 lecslab/polygloss-byt5-multitask-2025-12-28 Updated Dec 29, 2025 • 8 lecslab/polygloss-byt5-concat-2025-12-28 Updated Dec 29, 2025 • 7
GlossLM Multilingual IGT corpora and pretrained models lecslab/glosslm 0.6B • Updated Nov 4, 2024 • 28 • 3 lecslab/glosslm-unimorph-st_unseg_only 0.6B • Updated Jun 13, 2024 • 2 lecslab/glosslm-corpus Viewer • Updated Nov 4, 2024 • 451k • 52 • 2 lecslab/glosslm-corpus-split Viewer • Updated Mar 10, 2024 • 556k • 479