irish-quant/01-ai-Yi-1.5-6B-3bit
6B
•
Updated
•
4
Yi-1.5
This collection houses GPTQ quants of Yi-1.5 6B and 9B base and chat models.
-
-
irish-quant/01-ai-Yi-1.5-6B-2bit
6B • Updated • 4 -
irish-quant/01-ai-Yi-1.5-6B-4bit
6B • Updated • 4 -
irish-quant/01-ai-Yi-1.5-6B-8bit
6B • Updated • 3 -
irish-quant/01-ai-Yi-1.5-6B-Chat-4bit
6B • Updated • 4 -
irish-quant/01-ai-Yi-1.5-6B-Chat-2bit
6B • Updated • 5 -
irish-quant/01-ai-Yi-1.5-6B-Chat-3bit
6B • Updated • 4 -
irish-quant/01-ai-Yi-1.5-6B-Chat-8bit
6B • Updated • 4 -
irish-quant/01-ai-Yi-1.5-9B-2bit
9B • Updated • 4 -
irish-quant/01-ai-Yi-1.5-9B-3bit
8B • Updated • 5 -
irish-quant/01-ai-Yi-1.5-9B-4bit
9B • Updated • 4 -
irish-quant/01-ai-Yi-1.5-9B-8bit
9B • Updated • 4 -
irish-quant/01-ai-Yi-1.5-9B-Chat-2bit
9B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-9B-Chat-3bit
8B • Updated • 3 -
irish-quant/01-ai-Yi-1.5-9B-Chat-4bit
9B • Updated • 4 -
irish-quant/01-ai-Yi-1.5-9B-Chat-8bit
9B • Updated • 4