LLamaSharp/LLama.Examples/Examples
Martin Evans f0b0bbcbb7
Mutable Logits (#586)
Modified LLamaBatch to not share tokens with other sequences if logits is true. This ensures that the logit span at the end in used by exactly one sequence - therefore it's safe to mutate. This removes the need for copying _very_ large arrays (vocab size) and simplifies sampling pipelines.
2024-03-10 13:56:11 +00:00
..
BatchedExecutorFork.cs Classifier Free Guidance (#536) 2024-02-26 15:41:57 +00:00
BatchedExecutorGuidance.cs Mutable Logits (#586) 2024-03-10 13:56:11 +00:00
BatchedExecutorRewind.cs Classifier Free Guidance (#536) 2024-02-26 15:41:57 +00:00
ChatChineseGB2312.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
ChatSessionStripRoleName.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
ChatSessionWithHistory.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
ChatSessionWithRoleName.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
CodingAssistant.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
GetEmbeddings.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
GrammarJsonResponse.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
InstructModeExecute.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
InteractiveModeExecute.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
KernelMemory.cs LLamaSharp.Examples: Document Q&A with local storage (#532) 2024-02-23 00:44:06 +00:00
KernelMemorySaveAndLoad.cs LLamaSharp.Examples: Document Q&A with local storage (#532) 2024-02-23 00:44:06 +00:00
LoadAndSaveSession.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
LoadAndSaveState.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
QuantizeModel.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
SemanticKernelChat.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
SemanticKernelMemory.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
SemanticKernelPrompt.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
StatelessModeExecute.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00
TalkToYourself.cs LLama.Examples: improve model path prompt (#526) 2024-02-21 14:20:13 +00:00