tdooms/fw-tiny-old
0.1B • Updated • 2
Bilinear Transformers (FineWeb)
A small collection of Transformers with bilinear MLPs, trained on the FineWeb-Edu dataset.
A small collection of Transformers with bilinear MLPs, trained on the FineWeb-Edu dataset.