# UltraBERT Curation model sizes and sources

> UltraBERT Curation is Daniel van Strien's 380M-parameter model for data curation. It returns option probabilities and releases 516,964 training rows.

Updated 2026-11-04 (Australia/Adelaide)

By Daniel van Strien · Released: 2026-10-28 · OPEN

A 380M-parameter decision model for data curation: give it a web page, prompt, maths problem or library record and typed questions (topic, format, educational value, difficulty) and it returns a probability for every option. The release centres on its recipe: the data-building and training scripts are public, with source and labeller/licence metadata where known, and 516,964 of the 535,730 training rows are released (web text omitted).

## Facts

- Size: 380M parameters, UltraBERT-380M encoder plus a GLiClass scoring head
- Licence: Apache-2.0
- Open data: 516,964 of 535,730 training rows released, plus 1,020,000 FineWeb pages scored with it

## Claims and sources



## Links

- [Source: Hugging Face](<https://huggingface.co/davanstrien/ultrabert-380m-curation>)
- [Source: Recipe](<https://github.com/davanstrien/curation-decision-recipe>)

## Related projects

No related projects are listed in the registry.