Martin Evans f0b0bbcbb7 Mutable Logits (#586) ... Modified LLamaBatch to not share tokens with other sequences if logits is true. This ensures that the logit span at the end in used by exactly one sequence - therefore it's safe to mutate. This removes the need for copying _very_ large arrays (vocab size) and simplifies sampling pipelines.		2024-03-10 13:56:11 +00:00
..
BatchedExecutor.cs	Assorted small changes to clean up some code warnings	2024-02-17 23:07:10 +00:00
Conversation.cs	Mutable Logits (#586)	2024-03-10 13:56:11 +00:00
ConversationExtensions.cs	March Binary Update (#565)	2024-03-06 15:19:42 +00:00
Exceptions.cs	Assorted small changes to clean up some code warnings	2024-02-17 23:07:10 +00:00