def encode

bend-ml-bpe-tokenizer@0.1.3.0 · main.bend:82

import bend-ml-bpe-tokenizer@0.1.3.0/main.bend as BendMlBpeTokenizer

import Base

82# The table goes from the oldest rule to the newest (like merges.txt).
83def encode(+table: List<&2, Rule>, xs: List<&2, Tk>) -> List<&2, Tk>:
84  encode.go(table, Nil{}, xs)

Uses (4)

Used by (3)