def silu

bend-ml-llama@0.2.1.0 · main.bend:456

import bend-ml-llama@0.2.1.0/main.bend as BendMlLlama

import Base

456# silu(x) = x / (1 + exp(-x)), the form ATen's CPU kernel uses
457def silu(+x: F32) -> F32:
458  (x / (1.0 + F32.exp(F32.neg(x)) : F32) : F32)

Uses (5)

Used by (1)

bend-ml-llama@0.2.1.0/main:swiglu