Token

A token is a piece of text a model processes: a word, part of a word, punctuation or a sequence of bytes. Tokens measure the size of a request, an answer and the available context.