SlitherCode
/

tiny-edu-166m

custom-architecture

Model card Files Files and versions

tiny-edu-166m / tokenization_parchment.py

Commit History

Add TiktokenTokenizer (cl100k_base wrapper)

875a861
verified

SlitherCode commited on about 1 month ago

Add TiktokenTokenizer (cl100k_base wrapper)

f5605f0
verified

SlitherCode commited on about 1 month ago