BigScience Workshop

non-profit

https://bigscience.huggingface.co

bigscienceW

bigscience-workshop

AI & ML interests

A one-year long research workshop on large language models: the Summer of Language Models 21 🌸

Recent Activity

christopher new activity 14 days ago

bigscience/bloomz-560m:Fails to load with transformers v4.57+

nihalnayak authored a paper 21 days ago

Revisiting Generalization Across Difficulty Levels: It's Not So Easy

christopher new activity about 1 month ago

bigscience/petals-api:Bloom

View all activity

christopher

in bigscience/bloomz-560m 14 days ago

Fails to load with transformers v4.57+

#14 opened 14 days ago by

christopher

authored a paper 19 days ago

Economies of Open Intelligence: Tracing Power & Participation in the Model Ecosystem

Paper • 2512.03073 • Published 26 days ago • 4

monsoon-nlp

posted an update 22 days ago

Post

387

PatchDNA, a DNA foundation model based on Meta's BLT tokenization strategy https://www.biorxiv.org/content/10.1101/2025.11.28.691095v1

shannons

authored 3 papers 28 days ago

SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature

Paper • 2406.07835 • Published Jun 10, 2024 • 2

SPG: Sandwiched Policy Gradient for Masked Diffusion Language Models

Paper • 2510.09541 • Published Oct 10 • 15

DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research

Paper • 2511.19399 • Published 28 days ago • 60

christopher

in bigscience/petals-api about 1 month ago

Bloom

#2 opened about 1 month ago by

teelinsan

authored a paper 2 months ago

Language Models are Injective and Hence Invertible

Paper • 2510.15511 • Published Oct 17 • 69

christopher

authored a paper 2 months ago

The German Commons - 154 Billion Tokens of Openly Licensed Text for German Language Models

Paper • 2510.13996 • Published Oct 15 • 8

thomwolf

authored a paper 2 months ago

Robot Learning: A Tutorial

Paper • 2510.12403 • Published Oct 14 • 116

vumichien

authored a paper 2 months ago

MixtureVitae: Open Web-Scale Pretraining Dataset With High Quality Instruction and Reasoning Data Built from Permissive-First Text Sources

Paper • 2509.25531 • Published Sep 29 • 8

lvwerra

authored a paper 2 months ago

BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution

Paper • 2510.08697 • Published Oct 9 • 36

vumichien

authored a paper 2 months ago

BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution

Paper • 2510.08697 • Published Oct 9 • 36

christopher

posted an update 3 months ago

Post

538

Something very cool is cooking at

1 reply

·

monsoon-nlp

posted an update 3 months ago

Post

457

Bio LLMs train on many genomes, but can we encode differences within a species? TomatoTomato adds pangenome tokens to represent a domestic tomato and a wild tomato in one sequence 🍅 🧬
monsoon-nlp/tomatotomato-gLM2-150M-v0.1

HugoLaurencon

authored a paper 3 months ago

ARE: Scaling Up Agent Environments and Evaluations

Paper • 2509.17158 • Published Sep 21 • 35

yjernite

posted an update 3 months ago

Post

2603

Tremendous quality of life upgrade on the Hugging Face Hub - we now have auto-complete emojis 🤗 🥳 👏 🙌 🎉

Get ready for lots more very serious analysis on a whole range of topics from yours truly now that we have unlocked this full range of expression 😄 🤔 🗣 🙊

jaketae

authored 3 papers 4 months ago

What Language Model to Train if You Have One Million GPU Hours?

Paper • 2210.15424 • Published Oct 27, 2022 • 2

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Paper • 2211.05100 • Published Nov 9, 2022 • 35

Enhancing Few-shot Text-to-SQL Capabilities of Large Language Models: A Study on Prompt Design Strategies

Paper • 2305.12586 • Published May 21, 2023