234 lines
6.7 KiB
Markdown
234 lines
6.7 KiB
Markdown
# LLamaSharp
|
|
|
|
## LLama
|
|
|
|
[AntipromptProcessor](./llama.antipromptprocessor.md)
|
|
|
|
[ChatSession](./llama.chatsession.md)
|
|
|
|
[InstructExecutor](./llama.instructexecutor.md)
|
|
|
|
[InteractiveExecutor](./llama.interactiveexecutor.md)
|
|
|
|
[LLamaContext](./llama.llamacontext.md)
|
|
|
|
[LLamaEmbedder](./llama.llamaembedder.md)
|
|
|
|
[LLamaQuantizer](./llama.llamaquantizer.md)
|
|
|
|
[LLamaTransforms](./llama.llamatransforms.md)
|
|
|
|
[LLamaWeights](./llama.llamaweights.md)
|
|
|
|
[LLavaWeights](./llama.llavaweights.md)
|
|
|
|
[SessionState](./llama.sessionstate.md)
|
|
|
|
[StatefulExecutorBase](./llama.statefulexecutorbase.md)
|
|
|
|
[StatelessExecutor](./llama.statelessexecutor.md)
|
|
|
|
[StreamingTokenDecoder](./llama.streamingtokendecoder.md)
|
|
|
|
## LLama.Abstractions
|
|
|
|
[AdapterCollection](./llama.abstractions.adaptercollection.md)
|
|
|
|
[IContextParams](./llama.abstractions.icontextparams.md)
|
|
|
|
[IHistoryTransform](./llama.abstractions.ihistorytransform.md)
|
|
|
|
[IInferenceParams](./llama.abstractions.iinferenceparams.md)
|
|
|
|
[ILLamaExecutor](./llama.abstractions.illamaexecutor.md)
|
|
|
|
[ILLamaParams](./llama.abstractions.illamaparams.md)
|
|
|
|
[IModelParams](./llama.abstractions.imodelparams.md)
|
|
|
|
[ITextStreamTransform](./llama.abstractions.itextstreamtransform.md)
|
|
|
|
[ITextTransform](./llama.abstractions.itexttransform.md)
|
|
|
|
[LoraAdapter](./llama.abstractions.loraadapter.md)
|
|
|
|
[MetadataOverride](./llama.abstractions.metadataoverride.md)
|
|
|
|
[MetadataOverrideConverter](./llama.abstractions.metadataoverrideconverter.md)
|
|
|
|
[TensorSplitsCollection](./llama.abstractions.tensorsplitscollection.md)
|
|
|
|
[TensorSplitsCollectionConverter](./llama.abstractions.tensorsplitscollectionconverter.md)
|
|
|
|
## LLama.Batched
|
|
|
|
[AlreadyPromptedConversationException](./llama.batched.alreadypromptedconversationexception.md)
|
|
|
|
[BatchedExecutor](./llama.batched.batchedexecutor.md)
|
|
|
|
[CannotForkWhileRequiresInferenceException](./llama.batched.cannotforkwhilerequiresinferenceexception.md)
|
|
|
|
[CannotModifyWhileRequiresInferenceException](./llama.batched.cannotmodifywhilerequiresinferenceexception.md)
|
|
|
|
[CannotSampleRequiresInferenceException](./llama.batched.cannotsamplerequiresinferenceexception.md)
|
|
|
|
[CannotSampleRequiresPromptException](./llama.batched.cannotsamplerequirespromptexception.md)
|
|
|
|
[Conversation](./llama.batched.conversation.md)
|
|
|
|
[ConversationExtensions](./llama.batched.conversationextensions.md)
|
|
|
|
[ExperimentalBatchedExecutorException](./llama.batched.experimentalbatchedexecutorexception.md)
|
|
|
|
## LLama.Common
|
|
|
|
[AuthorRole](./llama.common.authorrole.md)
|
|
|
|
[ChatHistory](./llama.common.chathistory.md)
|
|
|
|
[FixedSizeQueue<T>](./llama.common.fixedsizequeue-1.md)
|
|
|
|
[InferenceParams](./llama.common.inferenceparams.md)
|
|
|
|
[MirostatType](./llama.common.mirostattype.md)
|
|
|
|
[ModelParams](./llama.common.modelparams.md)
|
|
|
|
## LLama.Exceptions
|
|
|
|
[GrammarExpectedName](./llama.exceptions.grammarexpectedname.md)
|
|
|
|
[GrammarExpectedNext](./llama.exceptions.grammarexpectednext.md)
|
|
|
|
[GrammarExpectedPrevious](./llama.exceptions.grammarexpectedprevious.md)
|
|
|
|
[GrammarFormatException](./llama.exceptions.grammarformatexception.md)
|
|
|
|
[GrammarUnexpectedCharAltElement](./llama.exceptions.grammarunexpectedcharaltelement.md)
|
|
|
|
[GrammarUnexpectedCharRngElement](./llama.exceptions.grammarunexpectedcharrngelement.md)
|
|
|
|
[GrammarUnexpectedEndElement](./llama.exceptions.grammarunexpectedendelement.md)
|
|
|
|
[GrammarUnexpectedEndOfInput](./llama.exceptions.grammarunexpectedendofinput.md)
|
|
|
|
[GrammarUnexpectedHexCharsCount](./llama.exceptions.grammarunexpectedhexcharscount.md)
|
|
|
|
[GrammarUnknownEscapeCharacter](./llama.exceptions.grammarunknownescapecharacter.md)
|
|
|
|
[LLamaDecodeError](./llama.exceptions.llamadecodeerror.md)
|
|
|
|
[LoadWeightsFailedException](./llama.exceptions.loadweightsfailedexception.md)
|
|
|
|
[RuntimeError](./llama.exceptions.runtimeerror.md)
|
|
|
|
## LLama.Extensions
|
|
|
|
[IContextParamsExtensions](./llama.extensions.icontextparamsextensions.md)
|
|
|
|
[IModelParamsExtensions](./llama.extensions.imodelparamsextensions.md)
|
|
|
|
## LLama.Grammars
|
|
|
|
[Grammar](./llama.grammars.grammar.md)
|
|
|
|
[GrammarRule](./llama.grammars.grammarrule.md)
|
|
|
|
## LLama.Native
|
|
|
|
[DecodeResult](./llama.native.decoderesult.md)
|
|
|
|
[GGMLType](./llama.native.ggmltype.md)
|
|
|
|
[GPUSplitMode](./llama.native.gpusplitmode.md)
|
|
|
|
[LLamaBatch](./llama.native.llamabatch.md)
|
|
|
|
[LLamaBeamsState](./llama.native.llamabeamsstate.md)
|
|
|
|
[LLamaBeamView](./llama.native.llamabeamview.md)
|
|
|
|
[LLamaChatMessage](./llama.native.llamachatmessage.md)
|
|
|
|
[LLamaContextParams](./llama.native.llamacontextparams.md)
|
|
|
|
[LLamaFtype](./llama.native.llamaftype.md)
|
|
|
|
[LLamaGrammarElement](./llama.native.llamagrammarelement.md)
|
|
|
|
[LLamaGrammarElementType](./llama.native.llamagrammarelementtype.md)
|
|
|
|
[LLamaKvCacheView](./llama.native.llamakvcacheview.md)
|
|
|
|
[LLamaKvCacheViewCell](./llama.native.llamakvcacheviewcell.md)
|
|
|
|
[LLamaKvCacheViewSafeHandle](./llama.native.llamakvcacheviewsafehandle.md)
|
|
|
|
[LLamaLogLevel](./llama.native.llamaloglevel.md)
|
|
|
|
[LLamaModelKvOverrideType](./llama.native.llamamodelkvoverridetype.md)
|
|
|
|
[LLamaModelMetadataOverride](./llama.native.llamamodelmetadataoverride.md)
|
|
|
|
[LLamaModelParams](./llama.native.llamamodelparams.md)
|
|
|
|
[LLamaModelQuantizeParams](./llama.native.llamamodelquantizeparams.md)
|
|
|
|
[LLamaNativeBatch](./llama.native.llamanativebatch.md)
|
|
|
|
[LLamaPoolingType](./llama.native.llamapoolingtype.md)
|
|
|
|
[LLamaPos](./llama.native.llamapos.md)
|
|
|
|
[LLamaRopeType](./llama.native.llamaropetype.md)
|
|
|
|
[LLamaSeqId](./llama.native.llamaseqid.md)
|
|
|
|
[LLamaToken](./llama.native.llamatoken.md)
|
|
|
|
[LLamaTokenData](./llama.native.llamatokendata.md)
|
|
|
|
[LLamaTokenDataArray](./llama.native.llamatokendataarray.md)
|
|
|
|
[LLamaTokenDataArrayNative](./llama.native.llamatokendataarraynative.md)
|
|
|
|
[LLamaTokenType](./llama.native.llamatokentype.md)
|
|
|
|
[LLamaVocabType](./llama.native.llamavocabtype.md)
|
|
|
|
[LLavaImageEmbed](./llama.native.llavaimageembed.md)
|
|
|
|
[NativeApi](./llama.native.nativeapi.md)
|
|
|
|
[NativeLibraryConfig](./llama.native.nativelibraryconfig.md)
|
|
|
|
[RopeScalingType](./llama.native.ropescalingtype.md)
|
|
|
|
[SafeLLamaContextHandle](./llama.native.safellamacontexthandle.md)
|
|
|
|
[SafeLLamaGrammarHandle](./llama.native.safellamagrammarhandle.md)
|
|
|
|
[SafeLLamaHandleBase](./llama.native.safellamahandlebase.md)
|
|
|
|
[SafeLlamaModelHandle](./llama.native.safellamamodelhandle.md)
|
|
|
|
[SafeLlavaImageEmbedHandle](./llama.native.safellavaimageembedhandle.md)
|
|
|
|
[SafeLlavaModelHandle](./llama.native.safellavamodelhandle.md)
|
|
|
|
## LLama.Sampling
|
|
|
|
[BaseSamplingPipeline](./llama.sampling.basesamplingpipeline.md)
|
|
|
|
[DefaultSamplingPipeline](./llama.sampling.defaultsamplingpipeline.md)
|
|
|
|
[GreedySamplingPipeline](./llama.sampling.greedysamplingpipeline.md)
|
|
|
|
[ISamplingPipeline](./llama.sampling.isamplingpipeline.md)
|
|
|
|
[ISamplingPipelineExtensions](./llama.sampling.isamplingpipelineextensions.md)
|
|
|
|
[Mirostate2SamplingPipeline](./llama.sampling.mirostate2samplingpipeline.md)
|
|
|
|
[MirostateSamplingPipeline](./llama.sampling.mirostatesamplingpipeline.md)
|