Yaohui Liu
ca6624edb3
Merge branch 'master' of github.com:SciSharp/LLamaSharp into rinne-dev
2023-09-02 12:03:35 +08:00
Rinne
4e83e48ad1
Merge pull request #122 from martindevans/gguf
...
Add GGUF support
2023-09-02 11:54:50 +08:00
97349d93be
Merge branch 'gguf' of github.com:martindevans/LLamaSharp into gguf
2023-09-02 02:22:18 +01:00
bcf06e2652
Added some comments on various native methods
2023-09-02 02:22:11 +01:00
4d079bf641
Merge pull request #140 from martindevans/grammar_exception_types
...
grammar_exception_types
2023-09-02 02:04:47 +01:00
af680ac2d7
Created a hierarchy of exceptions for grammar format issues. This allows the base catch-all exception to be caught for general handling, or more specific exceptions to be caught for more specific handling.
2023-09-02 02:04:11 +01:00
521f068d64
Add Embedding for Semantic Kernel
2023-09-01 22:42:13 +09:00
Rinne
1533ee7dbf
Merge pull request #138 from drasticactions/semantic-kernel
...
Enable Semantic kernel support
2023-09-01 20:50:46 +08:00
d4a57fffef
README, Cleanup
2023-09-01 10:03:34 +09:00
2bde188c64
Change Namespace
2023-08-31 22:22:38 +09:00
326c802be7
Have weights generate context
2023-08-31 22:19:29 +09:00
cb506cca1c
Merge pull request #4 from SignalRT/GGUF-MERGE
...
Changes to compile in VS Mac + change model to llama2
2023-08-31 14:00:41 +01:00
6b48157b20
Merge pull request #137 from martindevans/grammar_improvements
...
Higher Level Grammar System
2023-08-31 13:41:42 +01:00
a81edacbfb
Remove embedding for now
2023-08-31 18:26:03 +09:00
98bfbe1d50
Update
2023-08-31 18:24:07 +09:00
3bca3b632e
New line
2023-08-31 17:31:13 +09:00
9a1d6f99f2
Add Semantic Kernel support
2023-08-31 17:24:44 +09:00
a70c7170dd
- Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system.
...
- Made all the mechanics of grammar parsing (GBNFGrammarParser, ParseState) internal. Just call `Grammar.Parse("whatever")`.
- Added a `GrammarRule` class which validates elements on construction (this allows constructing grammar without parsing GBNF).
- It should be impossible for a `GrammarRule` to represent an invalid rule.
2023-08-31 00:02:50 +01:00
fb007e5921
Changes to compile in VS Mac + change model to llama2
...
This commit includes changes to compile en VS Mac + changest to use llama2 not codellama.
It includes MacOS binaries in memory and metal
2023-08-30 22:08:29 +02:00
40e76a70c5
Merge pull request #136 from Mihaiii/grammar_parser
...
Translating the grammar parser
2023-08-30 20:20:36 +01:00
24d3e1bfa8
Address PR review comment
2023-08-30 21:59:28 +03:00
60790c5aac
Address code review comments (create custom exception, move printing to the ParseState class, rethrow error).
2023-08-30 21:06:45 +03:00
71f02e08c2
Add grammar example
2023-08-30 17:24:39 +03:00
920efaca44
Add original test
2023-08-30 16:48:42 +03:00
2ae1891c13
Bug fixes after running tests.
...
SymbolIds is now SortedDictionary (although I'm not sure it really needs to be) because the test was failing due to expected value being in another order. The C++ data structure if SymbolIds is std::map<std::string, uint32_t> so the items are ordered by key.
2023-08-30 16:18:05 +03:00
0bd495276b
Add initial tests + fix bugs. Still WIP since the test is failing.
2023-08-30 14:10:56 +03:00
0f373fcc6d
Finish grammar_parser translation from C++ to C#
2023-08-30 12:20:45 +03:00
3c919b56fe
Use ReadOnlySpan everywhere instead of ReadOnlyMemeory and instead of returning tuple, reference the ReadOnlySpan.
2023-08-30 11:23:55 +03:00
8b4ec6d973
Address PR change requests
2023-08-30 09:24:08 +03:00
516c291e3f
Updated some of the docs
2023-08-29 23:11:46 +01:00
7f31276bdf
[WIP] Translating the GrammarParser
2023-08-29 22:50:54 +03:00
c9d08b943e
Added binaries for CUDA+Linux
2023-08-29 15:05:09 +01:00
e34491855e
Merge pull request #135 from martindevans/really-fixed-cublas-paths
...
Fixed those cublas paths again
2023-08-29 14:33:07 +01:00
229151ca37
Fixed those cublas paths again
2023-08-29 14:32:43 +01:00
d0ca63fea5
Merge pull request #134 from martindevans/final-linux-cublas-fix
...
Fixed the cublas linux paths again
2023-08-29 13:48:06 +01:00
dc4ef4f1a0
Fixed the cublas linux paths again
2023-08-29 13:47:45 +01:00
82b7c1a475
Merge pull request #133 from martindevans/linux_cublas_final_path
...
fixed linux cublas paths in final step
2023-08-29 13:08:30 +01:00
d695923711
fixed linux cublas paths in final step
2023-08-29 13:08:11 +01:00
bdc1ea6560
Merge pull request #132 from martindevans/linux-cublas
...
Fixed linux cublas filenames
2023-08-29 02:40:02 +01:00
c88717ace6
Fixed linux cublas file names
2023-08-29 02:39:15 +01:00
c7096948c0
Fixed linux cublas filenames
2023-08-29 02:36:24 +01:00
086fd5345c
Merge pull request #131 from martindevans/linux-cublas
...
Linux cublas
2023-08-29 01:45:24 +01:00
e4dc543d24
Removed x86_64 macos build
2023-08-29 00:58:05 +01:00
318ccd433f
Fixed linux cublas filepaths
2023-08-29 00:18:40 +01:00
86398d400d
Added cublas target for Linux
2023-08-28 23:52:15 +01:00
6711a59d0f
Included Linux deps
2023-08-28 20:02:59 +01:00
ba49ea2991
Removed hardcoded paths from projects, modified Runtime.targets to exclude missing binaries
2023-08-28 19:53:34 +01:00
2022b82947
Added binaries generated by this action: https://github.com/SciSharp/LLamaSharp/actions/runs/6002797872/job/16279896150
...
Based on this version: 6b73ef1201
2023-08-28 19:48:31 +01:00
f86aa98300
Merge pull request #130 from martindevans/cublas_fix_paths
...
Fixed cuda paths again
2023-08-28 18:05:25 +01:00
91ed8e8ccf
Fixed cuda paths again
2023-08-28 18:04:37 +01:00
Yaohui Liu
Martin Evans