netstandard2.0;net6.0;net7.0;net8.0
LLama
enable
10
AnyCPU;x64;Arm64
True
0.11.2
Rinne, Martin Evans, jlsantiago and all the other contributors in https://github.com/SciSharp/LLamaSharp/graphs/contributors.
SciSharp STACK
true
MIT, SciSharp STACK $([System.DateTime]::UtcNow.ToString(yyyy))
https://github.com/SciSharp/LLamaSharp
git
https://avatars3.githubusercontent.com/u/44989469?s=200&v=4
LLama, LLM, GPT, ChatGPT, NLP, AI, Chat Bot, SciSharp
LLamaSharp is a cross-platform library to run 🦙LLaMA/LLaVA model (and others) in your local device.
Based on [llama.cpp](https://github.com/ggerganov/llama.cpp), inference with LLamaSharp is efficient on both CPU and GPU.
With the higher-level APIs and RAG support, it's convenient to deploy LLM (Large Language Model) in your application with LLamaSharp.
LLamaSharp 0.11.2 fixed the performance issue of LLaVA on GPU and improved the log suppression.
MIT
packages
AnyCPU;x64;Arm64
LLamaSharp
Debug;Release;GPU
false
README.md
True