The Pile
Introduced by Gao et al. in The Pile: An 800GB Dataset of Diverse Text for Language Modeling
The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together.
Datasheet: Datasheet for the Pile
Papers
| Paper | Code | Results | Date | Stars |
|---|
