RxT-Beta Training Datasets
Collection
Datasets used to train RxT-Beta models - first generation of experimental Reactive Transformer (RxT) models trained on real-world data (English only) • 12 items • Updated
Need help to make the dataset viewer work? Make sure to review how to configure the dataset viewer, and open a discussion for direct support.
Code-based pre-training corpus for RxT-Beta models, created from public & open datasets. Includes code in different programming languages. Subsets are divided into short (< ~1024 tokens) and long (> ~1024 tokens) categories.
It's created from codeparrot datasets: