Icelandic ModernBERT encoders, 12M to 1B parameters, trained on open data: the size ladder and the warm-start study. MIT licence.
-
Beyond IceBERT: Open-Data ModernBERT Encoders for Icelandic from 12M to 1B Parameters
Paper • 2610.36230 • Published -
hafsteinn/icelandic-modernbert-ws-E-xl-s0
Fill-Mask • 1.0B • Updated • 108 -
hafsteinn/icelandic-modernbert-ws-S-xl-s0
Fill-Mask • 1.0B • Updated • 88 -
hafsteinn/icelandic-modernbert-large-160tpp
Fill-Mask • 0.4B • Updated • 51
