scisharp
/
LLamaSharp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,073 Commits 8 Branches 17 Tags 317 MiB
Commit Graph

1073 Commits

Author SHA1 Message Date
Martin Evans ad0aed5cdf
Merge branch 'master' into tokenization_cleanup 2023-08-07 19:01:35 +01:00
Martin Evans 1fceeaf352 Applied fix from #84 (antiprompt does not work in stateless executor) 2023-08-07 19:00:59 +01:00
Rinne 250c024402
Merge pull request #84 from SciSharp/rinne-dev 
fix: antiprompt does not work in stateless executor.
 2023-08-08 00:17:48 +08:00
Yaohui Liu d609b0e1d5
Merge branch 'master' of github.com:SciSharp/LLamaSharp into rinne-dev 2023-08-08 00:16:38 +08:00
Yaohui Liu b60c8bd285
fix: antiprompt does not work in stateless executor. 2023-08-08 00:16:23 +08:00
Martin Evans 2b2d3af26b Moved `Eval` out of `Utils` and into `SafeLLamaContextHandle` 2023-08-07 15:15:34 +01:00
Martin Evans 7fabcc1849 One last `TokenToString` case 2023-08-07 15:15:34 +01:00
Martin Evans 0e5e00e300 Moved `TokenToString` from Utils into `SafeLLamaContextHandle` (thin wrappers around the same method in `SafeLlamaModelHandle`) 2023-08-07 15:15:34 +01:00
Martin Evans 2d811b2603 - Moved `GetLogits` into `SafeLLamaContextHandle` 
- Added disposal check into `SafeLLamaContextHandle`
 2023-08-07 15:13:24 +01:00
Martin Evans cd3cf2b77d - Moved tokenization from `Utils.Tokenize` into `SafeLLamaContextHandle.Tokenize`, one less thing in `Utils`. 
- Also refactored it to return an `int[]` instead of an `IEnumerable<int>`, solving the "multiple enumeration" problems at the source!
 2023-08-07 15:13:24 +01:00
Martin Evans 73882de591
Merge pull request #81 from martindevans/tensor_splits_array 
Improved Tensor Splits
 2023-08-07 13:36:38 +01:00
Martin Evans a9880d5665
Merge pull request #83 from martindevans/FixedSizeQueue_size_check 
Cleaned up multiple enumeration in FixedSizeQueue
 2023-08-07 02:39:00 +01:00
Martin Evans bd3d8d3dc4 Cleaned up multiple enumeration in FixedSizeQueue 2023-08-07 02:23:46 +01:00
Martin Evans f2499371ea Pulled conversion of a `IModelParams` into a `LLamaContextParams` out into an extension method which can be used in other places. 2023-08-07 01:55:36 +01:00
Martin Evans f1111a9f8b Using a pin instead of a `fixed` block 2023-08-07 01:20:34 +01:00
Martin Evans 2c933c57a1 Fixed ModelOptions in Web project 2023-08-06 20:48:35 +01:00
Martin Evans 685eb3b9c2 Replaced `nint` with `float[]?` in Model params, which is much more user friendly! 2023-08-06 20:29:38 +01:00
Martin Evans 18b1df6762
Merge pull request #79 from saddam213/upstream_master 
ModelParams & InferenceParams abstractions
 2023-08-06 19:07:51 +01:00
sa_ddam213 e02d0c3617 Merge branch 'master' of https://github.com/SciSharp/LLamaSharp into upstream_master 2023-08-07 03:34:37 +12:00
Rinne 486c317887
docs: update README.md 2023-08-06 21:37:54 +08:00
Rinne 4d3cdbcd66
docs: add info about prerelease v0.4.2. 2023-08-06 21:36:44 +08:00
Rinne bfe9cc8961
Merge pull request #78 from SciSharp/rinne-dev 
feat: update the llama backends.
 2023-08-06 20:59:24 +08:00
Yaohui Liu 1b15d28fc9
ci: remove MACOS ci pipelines. 2023-08-06 20:35:39 +08:00
sa_ddam213 e46646b8db Merge branch 'master' of https://github.com/SciSharp/LLamaSharp into upstream_master 2023-08-07 00:01:37 +12:00
Martin Evans 5e15077766
Merge pull request #80 from saddam213/ExposeNative 
Expose some native classes
 2023-08-06 12:55:56 +01:00
Yaohui Liu bb46a990d0
fix: add bug info for native api. 2023-08-06 14:46:23 +08:00
Yaohui Liu e64c05126b
ci: update ci content. 2023-08-06 14:45:56 +08:00
Yaohui Liu f16db72841
ci: add debug info. 2023-08-06 14:08:33 +08:00
Yaohui Liu a59160a5cb
ci: update ci content. 2023-08-06 13:49:42 +08:00
Yaohui Liu 5fe13bd9f7
fix: update the dlls. 2023-08-06 13:46:57 +08:00
sa_ddam213 372894e1d4 Expose some native classes 2023-08-06 14:44:46 +12:00
sa_ddam213 bac9cba01a InferenceParams abstractions 2023-08-06 11:03:45 +12:00
sa_ddam213 2a04e31b7d ModelParams abstraction 2023-08-06 10:44:54 +12:00
Martin Evans d2e9f9d96d Added `ldd -r libllama.so` to try and discover is dependencies are missing 2023-08-05 23:20:12 +01:00
Yaohui Liu d3775c527e
ci: add info to debug the ci error. 2023-08-06 02:14:34 +08:00
Yaohui Liu 6b2a06902e
fix: the ci error. 2023-08-06 01:49:53 +08:00
Yaohui Liu 546ba28a68
fix: ci error caused by branch merge. 2023-08-06 01:48:31 +08:00
Yaohui Liu fc17e91d1a
feat: add backend for MACOS. 2023-08-06 01:30:56 +08:00
Yaohui Liu 9fcbd16b74
Merge branch 'master' of github.com:SciSharp/LLamaSharp into rinne-dev 2023-08-06 01:30:03 +08:00
Yaohui Liu 2968125daf
feat: update the llama backends. 2023-08-06 01:22:24 +08:00
Martin Evans fa75e9d964
Merge pull request #77 from SignalRT/master 
Update llama.cpp binaries to 5f631c2 and align the LlamaContext
 2023-08-05 16:56:31 +01:00
Martin Evans fe3bd11dfa
Merge branch 'master' into master 2023-08-05 16:56:18 +01:00
Martin Evans b2ef8e6a26
Merge pull request #74 from martindevans/github_actions 
GitHub actions
 2023-08-05 16:54:38 +01:00
Martin Evans d6fc83e981 - Added a folder with a 7B Llama2 model, automatically downloaded from huggingface. This can be used for unit tests. 
- Caching that folder, so CI only has to download it once.
 2023-08-05 14:38:47 +01:00
Martin Evans c46751ae66 Fixed yaml syntax 2023-08-05 14:38:47 +01:00
Martin Evans 1545b821d7 Cleaned up installing multiple dotnets 2023-08-05 14:38:47 +01:00
Martin Evans 71b1ccd2f7 Always installing both 6 and 7 2023-08-05 14:38:47 +01:00
Martin Evans 618e02fb9c - moved dotnet version into matrix 
- using 6.0.x instead of 7.0.x
 2023-08-05 14:38:47 +01:00
Martin Evans 7ef07104e7 Added queue fix, so that CI can pass 2023-08-05 14:38:47 +01:00
Martin Evans e7e3df6c6b fixed capitalisation 2023-08-05 14:38:47 +01:00