scisharp
/
LLamaSharp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
771 Commits 8 Branches 17 Tags 317 MiB
Commit Graph

771 Commits

Author SHA1 Message Date
Ian Foutz 060d7c273d Added a converter similar to the Open AI one 2023-11-18 21:42:34 -06:00
Martin Evans 8540c8d220
Merge pull request #312 from martindevans/removed_obsolete_modelparams_constructor 
Removed Obsolete ModelParams Constructor
 2023-11-18 12:25:01 +00:00
Martin Evans c6d507040c
Merge pull request #311 from martindevans/Improved_Test_Coverage 
Improved test coverage.
 2023-11-18 12:23:47 +00:00
Martin Evans c74f463d8e Removed the obsolete constructor in `ModelParams`, it was marked obsolete 3 months ago. 2023-11-18 02:46:09 +00:00
Martin Evans 48c5039054 Improved test coverage. Discovered some issues: 
FixedSizeQueue:
 - Enqueue would always stop one short of filling the capacity
 - Fill would only _replace_ existing items. It was only used in a place where there were not existing items! Removed the method entirely.

LLamaGrammarElement:
 - Converted into a `record` struct, removed all of the (now unnecessary) equality stuff.
 2023-11-18 02:40:36 +00:00
Rinne 22b3073e36
Merge pull request #306 from xbotter/deps/sk-1.0.0-beta8 
bump semantic kernel 1.0.0-beta8
 2023-11-18 02:23:39 +08:00
xbotter 1056e13414
fix examples 2023-11-17 22:21:43 +08:00
xbotter 15db931a66
bump semantic kernel 1.0.0-beta8 2023-11-17 21:17:27 +08:00
Rinne 8b6105faa0
docs: update README.md 2023-11-17 18:58:23 +08:00
Martin Evans c517cc18a2
Merge pull request #304 from martindevans/obsolete_attribute_eval 
Added Obsolete markings to all `Eval` overloads
 2023-11-17 02:16:49 +00:00
Martin Evans 16ab33ba3c Added Obsolete markings to all `Eval` overloads 2023-11-17 01:53:49 +00:00
Martin Evans 18b3a5595a
Merge pull request #303 from martindevans/expose_progress_callback 
progress_callback in `LLamaModelParams`
 2023-11-17 01:49:06 +00:00
Martin Evans 0e51badb38 Exposed `progress_callback` in `LLamaModelParams` (although not in higher level) 2023-11-17 01:40:04 +00:00
Martin Evans 9905baa7c4
Merge pull request #300 from martindevans/minor_demos_cleanup 
Minor cleanup on example code
 2023-11-17 01:38:54 +00:00
Martin Evans 4359752d94
Merge pull request #297 from martindevans/ubuntu-20.04 
Ubuntu 20.04 Compile
 2023-11-17 01:30:59 +00:00
Martin Evans 1970023ef4
Merge pull request #292 from martindevans/dotnet8.0 
dotnet8.0
 2023-11-17 01:30:00 +00:00
Martin Evans 1dd4c6ab7a
Merge pull request #296 from xbotter/deps/sk_1.0.0-beta6 
bump semantic kernel to 1.0.0-beta-6
 2023-11-17 01:28:50 +00:00
Martin Evans 479779e908 Some minor cleanup on example code: 
- Removed special case for exit
 - Added a wait at the end of batched decoding
 2023-11-17 01:28:05 +00:00
Martin Evans 9121670b83 Removed codeQL (broken under dotnet8.0 at the moment) 2023-11-16 13:59:20 +00:00
Martin Evans dc8c2309b6 Fixed conditionals 2023-11-15 21:15:50 +00:00
Martin Evans b52422a028 Moved compile job to run on `ubuntu-20.04`, hopefully picking up an older version of glibc with broader support. 2023-11-15 19:23:41 +00:00
Martin Evans 0bfc1cbecb
Merge pull request #295 from xbotter/patch/examples 
Update examples
 2023-11-15 19:17:38 +00:00
Rinne 36c2e64b36
Merge pull request #293 from martindevans/fixed_base_executor 
StreamingTextDecoder in LLamaExecutorBase
 2023-11-15 22:42:13 +08:00
xbotter 6c31f69720
bump semantic kernel to 1.0.0-beta-6 2023-11-15 15:53:06 +08:00
xbotter 521e36903c
🔀 Remove unused code and update examples 
- Renamed files and updated namespaces in Examples folder.
- Moved files from NewVersion folder to Examples folder.
- Removed TestRunner.cs file.
- Updated Runner.cs to include new examples.
- Update Program.cs to use the new Runner class instead of NewVersionTestRunner
- Update LLama.Examples namespace in Program.cs
- Update await NewVersionTestRunner.Run() in Program.cs to await Runner.Run()
 2023-11-15 15:37:22 +08:00
Martin Evans ecc614de7e
Merge pull request #294 from martindevans/fixed_revert_error 
Fixed Revert Error
 2023-11-15 02:09:47 +00:00
Martin Evans fe03e6ad35 Added 8.0 to version installation 2023-11-15 01:40:27 +00:00
Martin Evans 89fef05362 This commit (5fe721bdbe) accidentally removed a load of stuff that it shouldn't. Fixed that. 
Originally from these PRs:
 - https://github.com/SciSharp/LLamaSharp/pull/263
 - https://github.com/SciSharp/LLamaSharp/pull/259
 2023-11-15 01:36:33 +00:00
Martin Evans 3ce0f7d003 Using `StreamingTextDecoder` in `LLama/LLamaExecutorBase.cs`. This should fix weird text decoding issues with multi token characters. 2023-11-15 01:28:15 +00:00
Martin Evans e9f5dbba89 Processing AVX512 branch on all dotnet versions 2023-11-15 01:18:22 +00:00
Martin Evans e850115b5f Added dotnet8.0 as a build target 2023-11-15 01:09:37 +00:00
Martin Evans 8a966171e1
Merge pull request #288 from saddam213/access 
AntipromptProcessor access
 2023-11-14 14:29:09 +00:00
sa_ddam213 153e61a81f
Make AntipromptProcessor public 2023-11-14 21:41:12 +13:00
Martin Evans b44e780b0f
Merge pull request #281 from martindevans/NativeLibraryConfig_improvements 
CPU Feature Detection 2
 2023-11-13 23:26:31 +00:00
Rinne 972b0aaaab
Merge pull request #286 from SignalRT/FixWebExamples 
Add targets in Web project
 2023-11-14 07:18:12 +08:00
SignalRT 46ace3ddd7 Add targets in Web project 
This allow to copy binaries and make the project work.

Update example model in appsettings
 2023-11-13 23:26:29 +01:00
Martin Evans e8f024a03a
Merge pull request #283 from SciSharp/dependabot/nuget/Microsoft.NET.Test.Sdk-17.8.0 
build(deps): bump Microsoft.NET.Test.Sdk from 17.7.2 to 17.8.0
 2023-11-13 14:17:15 +00:00
dependabot[bot] f68aa777f1
build(deps): bump Microsoft.NET.Test.Sdk from 17.7.2 to 17.8.0 
Bumps [Microsoft.NET.Test.Sdk](https://github.com/microsoft/vstest) from 17.7.2 to 17.8.0.
- [Release notes](https://github.com/microsoft/vstest/releases)
- [Changelog](https://github.com/microsoft/vstest/blob/main/docs/releases.md)
- [Commits](https://github.com/microsoft/vstest/compare/v17.7.2...v17.8.0)

---
updated-dependencies:
- dependency-name: Microsoft.NET.Test.Sdk
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-13 06:38:31 +00:00
Martin Evans e3468d04f0
Merge pull request #277 from martindevans/feature/min_p 
MinP Sampler
 2023-11-13 02:15:52 +00:00
Martin Evans a9d1f6cb47 - Renamed `NativeLibraryConfig.Default` to `NativeLibraryConfig.Instance`. It's not default any more as soon as you call `WithX`! 
- using `Lazy<T>` to initialize it automatically.
 - Added in `AVX512` support for all dotnet versions (but not autodetected).
 - Added in AVX version auto detection.
 2023-11-13 02:05:07 +00:00
Rinne 597d32963a
docs: update README.md 2023-11-13 03:47:48 +08:00
Rinne 17ec8905c6
Merge pull request #275 from AsakusaRinne/cuda_detection 
feat: cuda feature detection.
 2023-11-13 02:08:05 +08:00
Rinne da6718c387
docs: adjust some descriptions. 2023-11-12 15:26:45 +08:00
Yaohui Liu 460f507898
ci: update ci workflows. 2023-11-12 14:54:43 +08:00
Yaohui Liu 502bb73b1e
fix typo. 2023-11-12 12:26:33 +08:00
Yaohui Liu d7675f7936
Merge branch 'master' of github.com:AsakusaRinne/LLamaSharp into cuda_detection 2023-11-12 12:10:31 +08:00
Rinne ed479d1739
Merge pull request #258 from SignalRT/RuntimeDetection 
Runtime detection MacOS
 2023-11-12 12:00:23 +08:00
Martin Evans d743516070 - Added support for the MinP sampler 
- Cleaned up comments in implementations of `IInferenceParams`
 - Removed default values for all parameters in `LLamaContext.Sample` - they're never used and probably _shouldn't_ ever be used
 2023-11-12 00:05:18 +00:00
SignalRT 0a2b0abb61 Correct improper rename 2023-11-12 00:27:53 +01:00
Yaohui Liu 4d2c5f1003
build: change nuget configuration for cuda detection. 2023-11-12 05:23:25 +08:00