LLamaSharp/LLama.Examples
Martin Evans f0b0bbcbb7
Mutable Logits (#586)
Modified LLamaBatch to not share tokens with other sequences if logits is true. This ensures that the logit span at the end in used by exactly one sequence - therefore it's safe to mutate. This removes the need for copying _very_ large arrays (vocab size) and simplifies sampling pipelines.
2024-03-10 13:56:11 +00:00
..
Assets LLamaSharp.Examples: Document Q&A with local storage (#532) 2024-02-23 00:44:06 +00:00
Examples Mutable Logits (#586) 2024-03-10 13:56:11 +00:00
Extensions Moved spinner out to an extension, so it can easily be used in other examples 2023-09-24 19:24:52 +01:00
ExampleRunner.cs Classifier Free Guidance (#536) 2024-02-26 15:41:57 +00:00
LLama.Examples.csproj build(deps): bump Microsoft.SemanticKernel and Microsoft.SemanticKernel.Abstractions (#572) 2024-03-05 00:58:43 +00:00
Program.cs Used `AnsiConsole` in a few more places: (#534) 2024-02-24 02:18:05 +00:00
UserSettings.cs Used `AnsiConsole` in a few more places: (#534) 2024-02-24 02:18:05 +00:00