scisharp
/
LLamaSharp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
473 Commits 8 Branches 17 Tags 317 MiB
Commit Graph

473 Commits

Author SHA1 Message Date
Martin Evans 6571e982e1 disabled `-march=native` for macos build which was causing a build failure 2023-10-12 00:00:28 +01:00
Martin Evans 2c9519bb56 sped up macos build 2023-10-11 23:56:09 +01:00
Martin Evans 56073e7d11
Merge pull request #182 from martindevans/async_stateless_eval 
Async Stateless Executor
 2023-09-29 22:25:26 +01:00
Martin Evans b7379b7124 Moved spinner out to an extension, so it can easily be used in other examples 2023-09-24 19:24:52 +01:00
Martin Evans d58fcbbd13 Fixed antiprompt checking 2023-09-24 14:26:43 +01:00
Martin Evans 08f1615e60 - Converted LLamaStatelessExecutor to run `Exec` calls inside an awaited task. This unblocks async callers while the model is being evaluated. 
- Added a "spinner" to the `StatelessModeExecute` demo, which spins while waiting for the next token (demonstrating that it's not blocked).
 2023-09-23 15:22:57 +01:00
Martin Evans 54b3eb0223
Merge pull request #179 from martindevans/extensions_tests 
Extensions Method Unit Tests
 2023-09-22 16:51:24 +01:00
Martin Evans fe54f6764f - Added unit tests for extension methods 
- Removed unused `AddRangeSpan` extension
 2023-09-22 16:29:50 +01:00
Rinne 4e68ee6117
docs: update document links in readme. 2023-09-20 17:59:50 +08:00
Haiping 79fa74d59c
Merge pull request #177 from redthing1/fix/context-getstate 
fix opaque GetState (fixes #176)
 2023-09-19 06:51:36 -05:00
redthing1 b78044347c
fix opaque GetState (fixes #176) 2023-09-18 20:56:14 -07:00
Haiping e1af7a96da
Merge pull request #175 from redthing1/feat/inferenceparams_record 
make InferenceParams a record so we can use `with`
 2023-09-18 19:44:18 -05:00
redthing1 296ba607de
make InferenceParams a record so we can use with 2023-09-18 13:27:26 -07:00
Haiping Chen 45426aefa9 Fix CodingAssistant InferAsync. 2023-09-17 10:33:31 -05:00
Haiping 10678a83d6
Merge pull request #65 from martindevans/alternative_dependency_loading 
CPU Feature Detection
 2023-09-17 10:21:37 -05:00
Haiping f134c5af59
Merge pull request #163 from SignalRT/DefaultMetal 
MacOS default build now is metal llama.cpp #2901
 2023-09-17 10:20:47 -05:00
Haiping 9f9903c711
Merge pull request #173 from martindevans/async_only 
Remove non-async
 2023-09-17 10:19:16 -05:00
Haiping c8bb680d66
Merge pull request #172 from Regenhardt/feature/coding-assistant 
Coding assistent example
 2023-09-17 10:17:47 -05:00
Martin Evans 3f80190f85 Minimal changes required to remove non-async inference. 2023-09-14 21:04:14 +01:00
Regenhardt Marlon 0049dcfb66 Coding Assistent: Improve user information and link to source paper 2023-09-13 17:04:08 +02:00
Regenhardt Marlon 71f4e2ae4a Coding Assistent: Use GGUF model 2023-09-13 15:45:44 +02:00
Marlon Regenhardt 2386be58c4 Example: Add code assistant using Code Llama-7b-Instruct as default 2023-09-13 15:21:06 +02:00
Martin Evans b1e9d8240d
Merge pull request #149 from martindevans/removed_unused_inference_params 
Removed unused properties of `InferenceParams` & `ModelParams`
 2023-09-13 01:48:15 +01:00
Martin Evans 6a04f05e06
Merge pull request #169 from drasticactions/sk-api-update 
SemanticKernel API Update
 2023-09-12 14:22:31 +01:00
Tim Miller 458679e36f Merge branch 'sk-api-update' of github.com:drasticactions/LLamaSharp into sk-api-update 2023-09-12 16:10:32 +09:00
Tim Miller 1b35da7e20 Merge branch 'master' into sk-api-update 2023-09-12 16:10:15 +09:00
Tim Miller abeab9f0a1 Bump dependencies 2023-09-12 12:19:57 +09:00
Martin Evans 84c077067e
Merge pull request #167 from martindevans/skip_empty_tokenisation 
skip_empty_tokenization
 2023-09-12 01:16:38 +01:00
Martin Evans daf09eae64 Skipping tokenization of empty strings (saves allocating an empty array every time) 2023-09-12 01:03:27 +01:00
Tim Miller dced651f8b Allow setting ChatRequestSettings Defaults and ChatSession 2023-09-11 19:21:51 +09:00
Martin Evans 466722dcff
Merge pull request #165 from martindevans/better_instruct_antiprompt_checking 
better_instruct_antiprompt_checking
 2023-09-11 00:32:43 +01:00
Martin Evans d08a125020 Using the `TokensEndsWithAnyString` extensions for antiprompt checking in instruct executor. Simpler and more efficient. 2023-09-11 00:22:17 +01:00
Martin Evans 149d076c98
Merge pull request #164 from martindevans/llama_get_kv_cache_token_count 
llama_get_kv_cache_token_count
 2023-09-11 00:22:12 +01:00
Martin Evans bba801f4b7 Added a property to get the KV cache size from a context 2023-09-11 00:10:08 +01:00
SignalRT d50c77434a Merge branch 'Development' of https://github.com/SignalRT/LLamaSharp into Development 2023-09-10 20:42:15 +02:00
SignalRT c41e448d0e ggml-metal.metal MUST be copied to output folder 
Metal depends on this file to execute, and MacOS llama.cpp defaults is now METAL.
 2023-09-10 20:42:15 +02:00
jlsantiago dd7e6351b1 Metal binaries should work in all cases (memory/metal) 2023-09-10 20:42:15 +02:00
SignalRT 097cf38b58 Merge branch 'Development' of https://github.com/SignalRT/LLamaSharp into Development 2023-09-10 20:42:15 +02:00
SignalRT 096293a026 MacOS Remove Metal as is the current default 
See on Mac OS enable Metal by default #2901
 2023-09-10 20:42:15 +02:00
SignalRT c7414472ba Merge branch 'Development' of https://github.com/SignalRT/LLamaSharp into Development 2023-09-10 20:39:42 +02:00
Martin Evans 400c7d4711 Fixed readme example code 2023-09-09 16:19:27 +01:00
Martin Evans b47977300a Removed one more unused parameter 2023-09-09 14:57:47 +01:00
Martin Evans a1b0349561 Removed `ModelAlias` property (unused) 2023-09-09 14:18:50 +01:00
Martin Evans 4dac142bd5
Merge pull request #160 from martindevans/GetState_fix 
`GetState()` fix
 2023-09-09 01:44:08 +01:00
Martin Evans b8d3fa123e
Merge pull request #159 from martindevans/removed_generate_result 
Removed `GenerateResult`
 2023-09-09 01:30:50 +01:00
Martin Evans 832bf7dbe0 Simplified implementation of `GetState` and fixed a memory leak (`bigMemory` was never freed) 2023-09-09 01:30:35 +01:00
Martin Evans 4f7b6ffdcc Removed `GenerateResult` method that was only used in one place 2023-09-09 01:09:27 +01:00
Martin Evans e074cd3273
Merge pull request #158 from saddam213/ILogger 
ILogger implementation
 2023-09-09 00:49:38 +01:00
sa_ddam213 09d8f434f2
Extract LLamaLogLevel, Remove Logger class 2023-09-09 10:25:05 +12:00
sa_ddam213 949b0cde16
Replace ILLamaLogger for ILogger 2023-09-09 10:13:07 +12:00