2022 · Collaborative research paper

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

A contribution to the BigScience collaboration on open multilingual language-model research.

Research question

How was a multilingual model built in the open?

Evidence and scope

BigScience brought together a large international research collaboration to document the training and release of BLOOM, a multilingual language model. I am one of the co-authors of the project paper.

The BigScience paper gives the full author list and describes the architecture, data and training process.

Primary source

Contribution
Davut Emre Taşar · Co-author
Source attribution
BigScience Workshop
Publication status
Collaborative research paper
Publication or platform
BigScience Workshop · arXiv
Identifier
arXiv:2211.05100

Sources

Research areas · Language

Related work