Tag: pretraining corpus

1 entry

PES2O Materials Science Pretraining Corpus 780M

Materials
A large-scale pretraining corpus for materials science, containing approximately 780M tokens of RefinedWeb data, designed for training AI models for materials discovery and molecular dynamics research.
See LICENSE file materials sciencepretraining corpusAI materials discovery

← All Tags