Martin Evans
|
f3511e390f
|
WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving.
The biggest single change is renaming `LLamaModel` to `LLamaContext`
|
2023-08-13 01:10:08 +01:00 |
|
Martin Evans
|
270c6d55ef
|
Merge pull request #88 from martindevans/fix_serialization_nan
Fix serialization error due to NaN
|
2023-08-08 14:04:18 +01:00 |
|
Martin Evans
|
be52737488
|
Using a nullable float instead of NaN, this should fix the serialization issue reported in #85
|
2023-08-07 21:09:18 +01:00 |
|
Martin Evans
|
1fceeaf352
|
Applied fix from #84 (antiprompt does not work in stateless executor)
|
2023-08-07 19:00:59 +01:00 |
 Yaohui Liu
|
d609b0e1d5
|
Merge branch 'master' of github.com:SciSharp/LLamaSharp into rinne-dev
|
2023-08-08 00:16:38 +08:00 |
|
Yaohui Liu
|
b60c8bd285
|
fix: antiprompt does not work in stateless executor.
|
2023-08-08 00:16:23 +08:00 |
|
Martin Evans
|
2b2d3af26b
|
Moved `Eval` out of `Utils` and into `SafeLLamaContextHandle`
|
2023-08-07 15:15:34 +01:00 |
|
Martin Evans
|
7fabcc1849
|
One last `TokenToString` case
|
2023-08-07 15:15:34 +01:00 |
|
Martin Evans
|
0e5e00e300
|
Moved `TokenToString` from Utils into `SafeLLamaContextHandle` (thin wrappers around the same method in `SafeLlamaModelHandle`)
|
2023-08-07 15:15:34 +01:00 |
|
sa_ddam213
|
bac9cba01a
|
InferenceParams abstractions
|
2023-08-06 11:03:45 +12:00 |
|
Martin Evans
|
c64507cb41
|
Correctly passing through mu value to mirostate instead of resetting it every time.
|
2023-07-30 00:15:52 +01:00 |
|
Martin Evans
|
ad28a5acdb
|
Merge branch 'master' into fix_multiple_enumeration
|
2023-07-24 22:13:49 +01:00 |
|
Rinne
|
4d7d4f2bfe
|
Merge pull request #59 from saddam213/master
Instruct & Stateless web example implemented
|
2023-07-24 23:28:04 +08:00 |
|
sa_ddam213
|
3fec7a63c7
|
Add Instruct and Stateless support
|
2023-07-23 16:31:28 +12:00 |
|
Martin Evans
|
f3fa73de2b
|
Implemented a new `LlamaModel.State` handle which internally stores the state as natively allocated memory. This allows it to exceed the 2GB limit on C# arrays.
|
2023-07-21 23:04:23 +01:00 |
|
Martin Evans
|
7cf1f8ac28
|
Fixed multiple cases where an `IEnumerable<T>` was enumerated multiple times.
|
2023-07-20 16:29:54 +01:00 |
|
Yaohui Liu
|
6c400e64c2
|
docs: publiash documentation 0.4.
|
2023-06-20 02:38:57 +08:00 |
|
Marcel
|
b911b2548b
|
move interfaces into abstractions folder
|
2023-06-15 22:06:47 +02:00 |
|
Yaohui Liu
|
3bf74ec9b9
|
feat: add chat session for refactored code.
|
2023-06-12 02:47:25 +08:00 |
|
Yaohui Liu
|
908b79e855
|
feat: add stateless executor.
|
2023-06-11 22:39:31 +08:00 |