Streaming
Domain: Models & Providers
Motivation
Receiving the model response token by token as it is generated, rather than waiting for the full response.
Concrete Example
Streaming: You see each word appear: The… weather… is… sunny. Like watching someone type. Faster perceived response vs waiting for full text.
Analogy
Watching a live sports broadcast vs a recording - live is more exciting. Streaming shows the response as it is generated.