scisharp
/
LLamaSharp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
LLamaSharp/docs/Examples/BatchedExecutorRewind.md

490 B
Raw Permalink Blame History

BatchedExecutor - Rewind

This example demonstrates using the BatchedExecutor to split one sequence into multiple sequences. See the source code here.

A single conversation is prompted and then continued for 24 tokens, after that it is re-wound by 12 tokens and continued from there. Rewinding simply sets the conversation back to an earlier state and requires no extra computation.