bend-ml-llama

Releases (4)

• 0.2.1.0 indexed
• 0.2.0.0 unindexed
• 0.1.1.0 unindexed
• 0.1.0.0 unindexed

Definitions (213)

main.bend

• def st_path
• def st_nth
• def t_layerthe tensors in w/st.txt's order (reference/prep.py's weights()): emb, then layer i's ln1 q k v o ln2 gate up down (j = 0..8), then lnf
• def st_check
• def read_stw/st.txt's numbers, two for each of the 2 + 9 * layers tensors
• def st_hi
• def st_lo
• def get_bandstensor t (w/st.txt's order) as bands of depth d
• def get_norma norm's n weights as a list (n * 2 bytes, read at once)
• def load_lw_stone layer's weights (tensors t_layer(i, 0..8)) from w/st.txt's numbers st; d: the band depth (depth_for)
• def load_lwlayer i's weights alone (layer_test); d: the band depth (depth_for)
• def load_layers
• def load_modelthe whole model; the embedding gets one more level of bands than the layers (2^5 with 16 threads)