Bendtorch.bu4: def of bendtorch@1.3.0.0 Import: import bendtorch@1.3.0.0/main.bend as Bendtorch Lines 2819-2824 of bendtorch@1.3.0.0/main.bend: https://jend.leeeet.dev/read.txt?path=bendtorch@1.3.0.0/main.bend&start_line=2819&end_line=2824 import Base # the backward pass's unit: one sequence's group j, as fslices' (Q, K, V, and dO's columns of the g heads), with # dQ, dK and dV of its own def bu4(+t: Nat, +gw: Nat, +hd: Nat, qq: Array, kk: Array, vv: Array, xs: List<&1, BG>, q: Array, k: Array, v: Array, r: A2) -> BL: match r: case A2{dd, d}: BL{qq, kk, vv, dd, BG{q, k, v, d, zeros_a(Nat.mul(t, gw)), zeros_a(Nat.mul(t, hd)), zeros_a(Nat.mul(t, hd))} <> xs} Uses (9): https://jend.leeeet.dev/definition.txt?path=Base/base.bend&name=Array https://jend.leeeet.dev/definition.txt?path=Base/base.bend&name=F32 https://jend.leeeet.dev/definition.txt?path=Base/base.bend&name=List https://jend.leeeet.dev/definition.txt?path=Base/base.bend&name=Nat https://jend.leeeet.dev/definition.txt?path=Base/base.bend&name=Nat.mul https://jend.leeeet.dev/definition.txt?path=bendtorch@1.3.0.0/main.bend&name=A2 https://jend.leeeet.dev/definition.txt?path=bendtorch@1.3.0.0/main.bend&name=BG https://jend.leeeet.dev/definition.txt?path=bendtorch@1.3.0.0/main.bend&name=BL https://jend.leeeet.dev/definition.txt?path=bendtorch@1.3.0.0/main.bend&name=zeros_a