Runtime · inference engine

The runtime is the program that loads a model and runs it, such as llama.cpp or Ollama.