Commit Graph

433 Commits

Author SHA1 Message Date
Tim Miller abeab9f0a1 Bump dependencies 2023-09-12 12:19:57 +09:00
Tim Miller dced651f8b Allow setting ChatRequestSettings Defaults and ChatSession 2023-09-11 19:21:51 +09:00
Martin Evans 466722dcff
Merge pull request #165 from martindevans/better_instruct_antiprompt_checking
better_instruct_antiprompt_checking
2023-09-11 00:32:43 +01:00
Martin Evans d08a125020 Using the `TokensEndsWithAnyString` extensions for antiprompt checking in instruct executor. Simpler and more efficient. 2023-09-11 00:22:17 +01:00
Martin Evans 149d076c98
Merge pull request #164 from martindevans/llama_get_kv_cache_token_count
llama_get_kv_cache_token_count
2023-09-11 00:22:12 +01:00
Martin Evans bba801f4b7 Added a property to get the KV cache size from a context 2023-09-11 00:10:08 +01:00
Martin Evans 400c7d4711 Fixed readme example code 2023-09-09 16:19:27 +01:00
Martin Evans 4dac142bd5
Merge pull request #160 from martindevans/GetState_fix
`GetState()` fix
2023-09-09 01:44:08 +01:00
Martin Evans b8d3fa123e
Merge pull request #159 from martindevans/removed_generate_result
Removed `GenerateResult`
2023-09-09 01:30:50 +01:00
Martin Evans 832bf7dbe0 Simplified implementation of `GetState` and fixed a memory leak (`bigMemory` was never freed) 2023-09-09 01:30:35 +01:00
Martin Evans 4f7b6ffdcc Removed `GenerateResult` method that was only used in one place 2023-09-09 01:09:27 +01:00
Martin Evans e074cd3273
Merge pull request #158 from saddam213/ILogger
ILogger implementation
2023-09-09 00:49:38 +01:00
sa_ddam213 09d8f434f2
Extract LLamaLogLevel, Remove Logger class 2023-09-09 10:25:05 +12:00
sa_ddam213 949b0cde16
Replace ILLamaLogger for ILogger 2023-09-09 10:13:07 +12:00
sa_ddam213 70b36f8996
Add Microsoft.Extensions.Logging.Abstractions, update any required deps 2023-09-09 09:52:11 +12:00
Martin Evans d3b8ee988c
Beam Search (#155)
* Added the low level bindings to beam search.
2023-09-07 19:26:51 +01:00
Martin Evans a09aa86324
Merge pull request #153 from martindevans/fix_savestate_OpenOrCreate
Changed `OpenOrCreate` to `Create`
2023-09-06 23:03:24 +01:00
Martin Evans 121b6357bf
Merge pull request #152 from martindevans/interact_antiprompt_matcing_improvement
Simplified `LLamaInteractExecutor` antiprompt matching
2023-09-06 22:38:30 +01:00
Martin Evans f366aa3abe Changed `OpenOrCreate` to `Create` to fix #151 2023-09-06 22:35:41 +01:00
Martin Evans 77bd090150 Simplified `LLamaInteractExecutor` antiprompt matching by using new extension method 2023-09-06 22:26:36 +01:00
Martin Evans 6cb0342f60
Merge pull request #150 from martindevans/better_antiprompt_checking
Better Antiprompt Testing
2023-09-06 21:37:57 +01:00
Martin Evans d0e57a8c92 sealed test class 2023-09-06 20:11:31 +01:00
Martin Evans 3f082c6f2c Fixed naming in tests 2023-09-06 20:09:41 +01:00
Martin Evans 614ba40948 - Added a `TokensEndsWithAnyString` extension to `IReadOnlyList<int>` which efficiently checks if a set of tokens ends with one of a set of strings.
- Minimal amount of characters converted
   - Allocation free
 - Added `TokensToSpan` to `SafeLlamaModelHandle` which converts as many tokens as possible into a character span
   - Allocation free
2023-09-06 19:44:19 +01:00
Haiping 23a7699f96
Update README.md 2023-09-05 23:39:01 -05:00
Yaohui Liu 4a0c60fe70
docs: update the readme. 2023-09-06 02:56:18 +08:00
Yaohui Liu 3067e01a4b
build: add package info for LLamaSharp.semantic-kernel 2023-09-06 02:50:23 +08:00
Rinne f3e23d692c
Merge pull request #139 from drasticactions/embeddings-semantickernel
Add TextEmbedding for Semantic Kernel
2023-09-06 02:11:29 +08:00
Tim Miller ab633089e9 Merge branch 'master' into embeddings-semantickernel 2023-09-05 13:53:24 +09:00
Martin Evans 037472cc3c
Merge pull request #147 from martindevans/llama2-7b-chat.gguf
Swapped to llama-7b-chat
2023-09-04 21:45:34 +01:00
Martin Evans 821d7f615e Swapped to llama-7b-chat 2023-09-04 21:26:02 +01:00
Martin Evans 4414e7f13f
Merge pull request #146 from martindevans/duplicate_llama_sample_classifier_free_guidance
Removed duplicate `llama_sample_classifier_free_guidance` method
2023-09-04 01:01:49 +01:00
Martin Evans 6a842014ac Removed duplicate `llama_sample_classifier_free_guidance` method 2023-09-04 00:48:27 +01:00
Martin Evans 74c19b10af
Merge pull request #145 from martindevans/disable_test_parallel
Disable test parallelism
2023-09-03 23:59:54 +01:00
Martin Evans 4a53cdc56b
Merge pull request #142 from SciSharp/rinne-dev
refactor: remove old version files.
2023-09-03 23:36:28 +01:00
Martin Evans 21cbecb82d Disable test parallelism to prevent fix CI 2023-09-03 23:35:53 +01:00
Martin Evans b70c07963d
Merge pull request #144 from martindevans/remove_LLamaNewlineTokens
Remove LLamaNewlineTokens from InteractiveExecutorState
2023-09-03 20:32:57 +01:00
Martin Evans 33035c82bf - Removed `LLamaNewlineTokens` from `InteractiveExecutorState`. This is always set in the constructor from the context, so there's no point serializing it. 2023-09-03 18:22:39 +01:00
jlsantiago 5a119c4ee1
Update MacOS Binaries (#143)
* Restore macOS pipelines
* Generate Metal binaries.
2023-09-03 15:15:40 +01:00
Tim Miller 6327a04342 Merge branch 'master' into embeddings-semantickernel 2023-09-03 23:02:17 +09:00
Yaohui Liu 18294a725e
refactor: remove old version files. 2023-09-02 22:24:07 +08:00
Martin Evans b1f33fa20e Placed the `noavx` file for Linux and Windows in the root `deps` folder, these will be used as the default if nothing else is loaded 2023-09-02 14:22:38 +01:00
Martin Evans cfb3defeee Changed paths to no longer include OS name (no need, .dll and .so file extensions are enough) 2023-09-02 14:17:35 +01:00
Martin Evans 025741a73e
Fixed My Name
The D is for my middle name 😄
2023-09-02 13:45:06 +01:00
Rinne b82e9f8fb0
Merge pull request #141 from SciSharp/rinne-dev
docs: update the docs to follow new version.
2023-09-02 17:57:23 +08:00
Tim Miller 94a395240a Bump example, readme 2023-09-02 14:21:02 +09:00
Yaohui Liu 20b5363601
fix: remove the history commit of embedding length property. 2023-09-02 12:56:02 +08:00
Tim Miller bea1ca9f8d Update 2023-09-02 13:54:38 +09:00
Yaohui Liu 3a847623ab
docs: update the docs to follow new version. 2023-09-02 12:51:51 +08:00
Tim Miller 35266d8112 Remove MemorySkill sample 2023-09-02 13:41:59 +09:00