BendMlLlama.smollm2_360m: def of bend-ml-llama@0.2.1.0
Import: import bend-ml-llama@0.2.1.0/main.bend as BendMlLlama
Lines 154-156 of bend-ml-llama@0.2.1.0/main.bend: https://jend.leeeet.dev/read.txt?path=bend-ml-llama@0.2.1.0/main.bend&start_line=154&end_line=156

import Base

# SmolLM2-360M: 5 key/value heads of 3 query heads each, heads of 64
def smollm2_360m() -> Cfg:
  Cfg{5n, 3n, 32n, 2560n, 32n, 49152n, 0.00001, 100000.0}

Uses (1):
  https://jend.leeeet.dev/definition.txt?path=bend-ml-llama@0.2.1.0/main.bend&name=Cfg