How to interrupt a streaming output?

[gy9527]

I haven't found a relevant API. Could you provide a code example?

[Appstun]

I have a similar question: Is it possible to interrupt a {LlamaChat}.generateResponse() in general?

[giladgd]

You can pass a signal option to the .prompt(...) method on a LlamaChatSession instance to abort the current generation.
To keep the current partial generated response, you can also set stopOnAbortSignal to true, which will make the main .prompt() call not throw an error.

It works the same way with LlamaChat's .generateResponse(...) method as well.

I'll make sure to add an example of this in the documentation.