Definition
Streaming output delivers portions of a result before the whole result has finished generating.
Usage and related concepts
Model APIs can deliver text fragments and status through server-sent events. Streaming affects when users first see output; display behavior, total completion time, and inference speed are separate concerns.