Ilyas Moutawwakil 4fc708f98c Exllama kernels support for AWQ models (#28634) ... * added exllama kernels support for awq models * doc * style * Update src/transformers/modeling_utils.py Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> * refactor * moved exllama post init to after device dispatching * bump autoawq version * added exllama test * style * configurable exllama kernels * copy exllama_config from gptq * moved exllama version check to post init * moved to quantization dockerfile --------- Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>		2024-03-05 03:22:48 +01:00
..
__init__.py	[`core` / `Quantization` ] AWQ integration (#27045)	2023-11-01 09:06:31 +01:00
test_awq.py	Exllama kernels support for AWQ models (#28634)	2024-03-05 03:22:48 +01:00