H2O-Lightning-4B

By H2O.ai · Released 7 Oct 2026

A 4B open model built on Qwen3.5-4B that runs on unmodified vLLM. Version 1.2.2 takes up to four images per request.

Facts

Size: 4B
Licence: Apache-2.0

Claims and sources

Its text-only v1.1 ranked #1 of 104 open-weight systems on JevBench v1.6.1's composite, 72.5 to Jev 1.13's 71.5, read 7 Oct 2026 vendor reportedsource

Links

Source: Announcement → Source: Hugging Face →

Related projects

Decision model kernels: a faster llama.cpp on one GPU

Source: WyrmKeep/decision-model-kernels ↗

A lab notebook for speeding up one decision model, H2O Lightning 4B, served through llama.cpp on an RTX 3060 Ti. Each request takes 2.13 to 2.45 times its roofline floor. The first measured change, a llama.cpp pull request, cut latency by 1.94% with bit-for-bit identical answers; the bigger gains in its list of 15 targets are labelled predictions.

WyrmKeep · ★ 0 · MIT · H2O-Lightning-4B

inference
llama.cpp
cuda

All projects · Back to the model registry