 Yaohui Liu
|
e926b0690f
|
docs: add comments to LLamaModel methods.
|
2023-05-21 02:17:27 +08:00 |
|
Yaohui Liu
|
4e1b6cf4e9
|
fix: optimize loading and saving state.
|
2023-05-21 02:09:15 +08:00 |
|
Yaohui Liu
|
55d5a8ae51
|
fix: quantization error with fp16.
|
2023-05-20 23:51:22 +08:00 |
|
Yaohui Liu
|
19979f664a
|
feat: support loading and saving state.
|
2023-05-20 14:01:20 +08:00 |
|
Yaohui Liu
|
d6bd1b7107
|
fix: add check for model file path.
|
2023-05-18 14:03:06 +08:00 |
|
Yaohui Liu
|
a65ad44291
|
build: add readme to package.
|
2023-05-18 05:33:03 +08:00 |
|
Yaohui Liu
|
2490cf17f4
|
build: update to v0.2.3.
|
2023-05-18 04:09:54 +08:00 |
|
Yaohui Liu
|
00d91cf99e
|
refactor: some parts of code of LLamaModel.
|
2023-05-18 03:59:55 +08:00 |
|
Yaohui Liu
|
afedd3c949
|
fix: errors when input is not English or too long.
|
2023-05-18 02:45:30 +08:00 |
|
Yaohui Liu
|
ea5f9d38ac
|
fix: always add bos when inference.
|
2023-05-17 12:53:31 +08:00 |
|
Yaohui Liu
|
1fca06dc7f
|
fix: n_gpu_layers miss in llama context.
|
2023-05-17 04:22:54 +08:00 |
|
Yaohui Liu
|
4314f64b9c
|
feat: add check for backend package.
|
2023-05-17 03:40:45 +08:00 |
|
Yaohui Liu
|
bcd4c5605b
|
feat: add n_gpu_layers and prompt_cache_all params.
|
2023-05-17 03:18:01 +08:00 |
|
Yaohui Liu
|
f17fd889be
|
build: optimize the building of LLama.
|
2023-05-17 03:04:28 +08:00 |
|
Yaohui Liu
|
9c0f3aedba
|
refactor: change some file names.
|
2023-05-16 02:55:25 +08:00 |
|
Yaohui Liu
|
f5a01c346d
|
feat: enable history for chat session.
|
2023-05-16 02:54:22 +08:00 |
|
Yaohui Liu
|
aa2b064d1d
|
fix: add IDisposable to model classes.
|
2023-05-16 02:51:02 +08:00 |
|
Yaohui Liu
|
6ffcb5306b
|
refactor: use official api of quantization instead.
|
2023-05-13 15:02:19 +08:00 |
|
Yaohui Liu
|
0958bbac2c
|
feat: add get-embedding api to LLamaModel.
|
2023-05-13 02:08:03 +08:00 |
|
Yaohui Liu
|
d76619c01b
|
docs: add more comments to obselete class LLamaModelV1.
|
2023-05-13 00:06:57 +08:00 |
Haiping Chen
|
21c36cbf80
|
Added WebAPI.
|
2023-05-11 21:45:34 -05:00 |
|
Yaohui Liu
|
a9a5bbdbd3
|
build: revise the building of master branch.
|
2023-05-11 20:04:51 +08:00 |
|
Yaohui Liu
|
33067f990f
|
feat: run quantization in csharp.
|
2023-05-11 17:38:28 +08:00 |
|
Yaohui Liu
|
118d410d52
|
build: revise build informations.
|
2023-05-11 13:57:57 +08:00 |
|
Yaohui Liu
|
856d6549de
|
build: add linux support.
|
2023-05-11 04:20:56 +08:00 |
|
Yaohui Liu
|
02524ae4eb
|
build: add package informations.
|
2023-05-11 04:07:02 +08:00 |
|
Yaohui Liu
|
fce10f3c4f
|
feat: add ChatSession.
|
2023-05-11 03:19:12 +08:00 |
|
Yaohui Liu
|
d6a7997e46
|
feat: add gpt model.
|
2023-05-10 20:48:16 +08:00 |
|
Yaohui Liu
|
5a79edeb51
|
feat: add the framework and basic usages.
|
2023-05-10 02:13:41 +08:00 |