scisharp
/
LLamaSharp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,290 Commits 8 Branches 17 Tags 317 MiB
Commit Graph

1290 Commits

Author SHA1 Message Date
Martin Evans f21a640904 MacOS CI has been flakey for months, taking 2 or 3 attempts on every PR before it finally passes. Disabled it. 2024-04-14 15:35:58 +01:00
Martin Evans c760cb5f16 - Fixed beam search test to use decode 
- Enabled it in CI
 2024-04-13 21:36:54 +01:00
SignalRT 0cf6073378 Revert "Try MacOS ARM availability" 
This reverts commit f29f61ee0f.
 2024-04-13 17:49:54 +02:00
SignalRT f29f61ee0f Try MacOS ARM availability 2024-04-13 17:38:49 +02:00
SignalRT 168f697db6 Clean up and align documentation with the changes in the interface 2024-04-13 16:34:32 +02:00
SignalRT aa11562f62 Link the llama.cpp reference about reset llava contex 2024-04-13 11:59:16 +02:00
SignalRT d6890e4ec4 Initial approach to clear images 2024-04-13 11:33:41 +02:00
Martin Evans 64db478578 Removed `ContextSize` from most examples. If it's not set it's retrieved from the model, which is usually what you want! 2024-04-12 23:57:08 +01:00
jlsantiago 8dd9101f8d
Merge pull request #653 from zsogitbe/master 
Extension LLava with in memory images
 2024-04-12 22:40:41 +02:00
Rinne c74913967a
Merge pull request #656 from Lyrcaxis/speech-to-text-example 
Added Whisper.net x LLamaSharp examples for Speech Chat
 2024-04-08 23:44:14 +08:00
Lyrcaxis b66b49de58 typo fix 2024-04-08 17:46:16 +03:00
Lyrcaxis c3cddcfafb Better Title for the SpeechChat example 2024-04-08 17:41:14 +03:00
Zoli Somogyi f4fad825c7 Simplifying image handling 2024-04-08 16:10:54 +02:00
Lyrcaxis e9bc6b6726 cr x 2024-04-08 15:44:31 +03:00
Lyrcaxis 8316c2c3c0 addressed change requests 2024-04-08 15:42:50 +03:00
Lyrcaxis 8c94659dbc naming adjustments & beam sampling 2024-04-08 13:33:47 +03:00
Zoli Somogyi 44a82b0f3f Download image implementation 2024-04-08 10:06:04 +02:00
Lyrcaxis c86d4b9aba spaces vs tabs 2024-04-08 00:10:56 +03:00
Lyrcaxis 417ed94a46 Example with GPU support 2024-04-08 00:09:38 +03:00
Martin Evans 4ff01e9968
Merge pull request #657 from martindevans/updated-build-script 
- Added new build define (`-DLLAMA_METAL_EMBED_LIBRARY=ON`) to MacOS build
- Upgraded actions to latest version (#657)
 2024-04-07 20:45:04 +01:00
Martin Evans ede2c25f17 - Upgraded actions to latest version 
- Added new build define (`-DLLAMA_METAL_EMBED_LIBRARY=ON`) to MacOS build
 2024-04-07 20:18:55 +01:00
Zoli Somogyi e991e631f9 Standardizing Image Data implementation 2024-04-07 19:47:39 +02:00
Lyrcaxis 469ec0d68a minor fixup 2024-04-07 19:16:19 +03:00
Lyrcaxis 9e513204db Added Whisper.net x LLamaSharp examples for Speech Detection and Speech Chat 2024-04-07 18:58:27 +03:00
Zoli Somogyi d3c5a42040 Extension LLava with in memory images 2024-04-06 17:22:29 +02:00
Rinne be980edcb0
Merge pull request #651 from AsakusaRinne/release_0.11.2 
[Release] v0.11.2
 2024-04-06 14:27:26 +08:00
Rinne c73658298f docs: update the readme. 2024-04-06 14:23:05 +08:00
Rinne 544a38d3bd Merge branch 'master' of github.com:AsakusaRinne/LLamaSharp into release_0.11.2 2024-04-06 14:22:00 +08:00
Rinne 4640c6af04 release: update release info of packages. 2024-04-06 14:20:36 +08:00
Rinne 045850819e
Merge pull request #647 from AsakusaRinne/fix_llava_backend 
fix: add cuda llava native libraries.
 2024-04-06 14:19:51 +08:00
Martin Evans 58107bb5b9
Logging interceptor (#649) 
* - Added `NativeLogConfig` which allows overriding the llama.cpp log callback
 - Delaying binding of this into llama.cpp until after `NativeLibraryConfig` has loaded

* Using the log callback to show loading log messages during loading.

* Registering log callbacks before any calls to llama.cpp except `llama_empty_call`, this is specifically selected to be a method that does nothing and is just there for triggering DLL loading.

* - Removed much of the complexity of logging from `NativeApi.Load`. It always call whatever log callbacks you have registered.
 - Removed alternative path for `ILogger` in NativeLibraryConfig, instead it redirects to wrapping it in a delegate.

* Saving a GC handle to keep the log callback alive

* Removed prefix, logger should already do that.

* Buffering up messages until a newline is encountered before passing log message to ILogger.

* - Added trailing `\n` to log messages from loading.
 - Using `ThreadLocal<StringBuilder>` to ensure messages from separate threads don't get mixed together.
 2024-04-05 16:42:27 +01:00
Rinne ec8f832365
fix: add cuda llava native libraries. 2024-04-04 00:47:33 +08:00
Rinne fa73c8f07c
fix: auto-compile ci. 2024-04-02 14:19:36 +08:00
Rinne 4dbe77a992
ci: add debug log to compile.yml 2024-04-02 13:12:40 +08:00
Rinne 04a761ab04
Merge pull request #642 from AsakusaRinne/fix_llava_backend 
fix: llava backend ignores avx and cuda.
 2024-04-02 10:48:45 +08:00
liuyaohui.lyh f7bd458341 fix: llava backend ignores avx and cuda. 2024-04-02 10:46:49 +08:00
Martin Evans a9d6a0791e
Fixed link to 0.11.0 llama.cpp commit id (#641) 2024-04-02 02:05:41 +01:00
Rinne 4038a39843
Merge pull request #637 from SciSharp/dependabot/nuget/Microsoft.Extensions.Logging.Abstractions-8.0.1 
build(deps): bump Microsoft.Extensions.Logging.Abstractions from 8.0.0 to 8.0.1
 2024-04-01 16:16:45 +08:00
Rinne 347301b10e
Merge pull request #638 from SciSharp/dependabot/nuget/Microsoft.AspNetCore.OpenApi-8.0.3 
build(deps): bump Microsoft.AspNetCore.OpenApi from 8.0.2 to 8.0.3
 2024-04-01 16:16:33 +08:00
Rinne 1fdde7ea2d
Merge pull request #636 from SciSharp/dependabot/nuget/System.Text.Json-8.0.3 
build(deps): bump System.Text.Json from 8.0.2 to 8.0.3
 2024-04-01 16:15:44 +08:00
dependabot[bot] 57c1ecf7af
build(deps): bump Microsoft.AspNetCore.OpenApi from 8.0.2 to 8.0.3 
Bumps [Microsoft.AspNetCore.OpenApi](https://github.com/dotnet/aspnetcore) from 8.0.2 to 8.0.3.
- [Release notes](https://github.com/dotnet/aspnetcore/releases)
- [Changelog](https://github.com/dotnet/aspnetcore/blob/main/docs/ReleasePlanning.md)
- [Commits](https://github.com/dotnet/aspnetcore/compare/v8.0.2...v8.0.3)

---
updated-dependencies:
- dependency-name: Microsoft.AspNetCore.OpenApi
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-04-01 06:40:03 +00:00
dependabot[bot] 1bfb900fbe
build(deps): bump Microsoft.Extensions.Logging.Abstractions 
Bumps [Microsoft.Extensions.Logging.Abstractions](https://github.com/dotnet/runtime) from 8.0.0 to 8.0.1.
- [Release notes](https://github.com/dotnet/runtime/releases)
- [Commits](https://github.com/dotnet/runtime/compare/v8.0.0...v8.0.1)

---
updated-dependencies:
- dependency-name: Microsoft.Extensions.Logging.Abstractions
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-04-01 06:38:51 +00:00
dependabot[bot] 1d163352a0
build(deps): bump System.Text.Json from 8.0.2 to 8.0.3 
Bumps [System.Text.Json](https://github.com/dotnet/runtime) from 8.0.2 to 8.0.3.
- [Release notes](https://github.com/dotnet/runtime/releases)
- [Commits](https://github.com/dotnet/runtime/compare/v8.0.2...v8.0.3)

---
updated-dependencies:
- dependency-name: System.Text.Json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-04-01 06:33:06 +00:00
Rinne 3bc952cf60
Merge pull request #633 from AsakusaRinne/doc_ci 
fix: the missing of llava_shared library.
 2024-04-01 04:44:15 +08:00
Rinne b941540aaf
fix errors in nuspecs. 2024-04-01 04:41:51 +08:00
Rinne d104d9a85b
fix the missing of llava_shared library. 2024-04-01 04:29:00 +08:00
Rinne 27a8ab3fd3
docs: fix typo of README. 2024-04-01 03:25:11 +08:00
Rinne b4317eebbe
Merge pull request #632 from AsakusaRinne/master 
Release version 0.11.0
 2024-04-01 02:59:44 +08:00
Rinne f1cb0e3b35
Merge pull request #631 from evolcano/master 
Add path to find llama.dll for MAUI
 2024-04-01 02:05:44 +08:00
Rinne 53092ebf5d
Merge pull request #25 from AsakusaRinne/doc_ci 
docs: update the information to v0.11.0.
 2024-04-01 01:53:25 +08:00