Martin Evans f0b0bbcbb7 Mutable Logits (#586) ... Modified LLamaBatch to not share tokens with other sequences if logits is true. This ensures that the logit span at the end in used by exactly one sequence - therefore it's safe to mutate. This removes the need for copying _very_ large arrays (vocab size) and simplifies sampling pipelines.		2024-03-10 13:56:11 +00:00
..
BaseSamplingPipeline.cs	Mutable Logits (#586)	2024-03-10 13:56:11 +00:00
DefaultSamplingPipeline.cs	Mutable Logits (#586)	2024-03-10 13:56:11 +00:00
GreedySamplingPipeline.cs	Mutable Logits (#586)	2024-03-10 13:56:11 +00:00
ISamplingPipeline.cs	Mutable Logits (#586)	2024-03-10 13:56:11 +00:00
Mirostat2SamplingPipeline.cs	Mutable Logits (#586)	2024-03-10 13:56:11 +00:00
MirostatSamplingPipeline.cs	Mutable Logits (#586)	2024-03-10 13:56:11 +00:00