BendMlTensor.gelu.f: def of bend-ml-tensor@0.1.2.0
Import: import bend-ml-tensor@0.1.2.0/main.bend as BendMlTensor
Lines 354-356 of bend-ml-tensor@0.1.2.0/main.bend: https://jend.leeeet.dev/read.txt?path=bend-ml-tensor@0.1.2.0/main.bend&start_line=354&end_line=356

import Base

# GELU with the tanh approximation (the same as GPT-2)
def gelu.f(+x: F32) -> F32:
  (0.5 * (x * (1.0 + F32.tanh((0.7978846 * (x + (0.044715 * (x * (x * x : F32) : F32) : F32) : F32) : F32)) : F32) : F32) : F32)

Uses (4):
  https://jend.leeeet.dev/definition.txt?path=Base/base.bend&name=F32
  https://jend.leeeet.dev/definition.txt?path=Base/base.bend&name=F32.add
  https://jend.leeeet.dev/definition.txt?path=Base/base.bend&name=F32.mul
  https://jend.leeeet.dev/definition.txt?path=Base/base.bend&name=F32.tanh