BendMlLlama.smollm2_1_7b: def of bend-ml-llama@0.2.1.0
Import: import bend-ml-llama@0.2.1.0/main.bend as BendMlLlama
Lines 158-160 of bend-ml-llama@0.2.1.0/main.bend: https://jend.leeeet.dev/read.txt?path=bend-ml-llama@0.2.1.0/main.bend&start_line=158&end_line=160

import Base

# SmolLM2-1.7B: 32 key/value heads of one query head each (plain multi-head attention), heads of 64
def smollm2_1_7b() -> Cfg:
  Cfg{32n, 1n, 32n, 8192n, 24n, 49152n, 0.00001, 130000.0}

Uses (1):
  https://jend.leeeet.dev/definition.txt?path=bend-ml-llama@0.2.1.0/main.bend&name=Cfg