law layout_135m

bend-ml-llama@0.2.1.0 · main.bend:197

import Base

197# LAW (layout): the shapes the types give to SmolLM2-135M's weights add up to 134,515,008 numbers,
198# SmolLM2-360M's to 361,821,120 and SmolLM2-1.7B's to 1,711,376,384: the number of values in each model.safetensors (reference/prep.py counts them).
199# The loader checks every file's size against the shape in its type, so together the files cover the checkpoint
200# exactly. In U32, whose sums wrap at 2^32; every partial sum here is below it, so this is the exact count.
201law layout_135m:
202  {Cfg.size(smollm2_135m()) == (134515008 : U32) : U32}