Term
模型推理
Next Token / Wiki

Model inference

Model inference applies a trained model to inputs to produce predictions or generated outputs.

Definition

Model inference applies a trained model to inputs to produce predictions or generated outputs.

Training learns model parameters; inference uses them for a task. Generating a response with a language model is inference. Visible reasoning steps are one form of output, not a complete view of the underlying computation.

Sources