LLamaSharp/docs/xmldocs/llama.native.gpusplitmode.md

821 B

GPUSplitMode

Namespace: LLama.Native

public enum GPUSplitMode

Inheritance ObjectValueTypeEnumGPUSplitMode
Implements IComparable, IFormattable, IConvertible

Remarks:

llama_split_mode

Fields

Name Value Description
None 0 Single GPU
Layer 1 Split layers and KV across GPUs
Row 2 split rows across GPUs