YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details.
AI & ML interests
None defined yet.
Organization Card
Chris De Sa's lab at Cornell. https://github.com/Cornell-RelaxML
https://github.com/Cornell-RelaxML/quip-sharp
-
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 21 -
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation β’ 5B β’ Updated β’ 21 -
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation β’ 1B β’ Updated β’ 19 -
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 18
YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details.
https://github.com/Cornell-RelaxML/quip-sharp
-
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 21 -
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation β’ 5B β’ Updated β’ 21 -
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation β’ 1B β’ Updated β’ 19 -
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 18
models
65
relaxml/Llama-2-7B-Hessians-2Sided
Updated
relaxml/Llama-3.1-70B-Instruct-4Bit-YAQA-QTIP
19B
β’
Updated
β’
7
relaxml/Llama-3.1-70B-Instruct-3Bit-YAQA-QTIP
15B
β’
Updated
β’
9
relaxml/Llama-3.1-70B-Instruct-2Bit-YAQA-QTIP
11B
β’
Updated
β’
9
relaxml/Llama-3.2-3B-Instruct-Hessians-2Sided
Updated
relaxml/Llama-3.2-1B-Instruct-Hessians-2Sided
Updated
relaxml/Llama-3.1-8B-Instruct-Hessians-2Sided
Updated
relaxml/Llama-3.1-70B-Instruct-Hessians-2Sided
Updated
relaxml/Gemma-3-12B-Instruct-QAT-Q4_0-Dequantized
12B
β’
Updated
β’
6
relaxml/Gemma-3-12B-Instruct-Hessians-2Sided
Updated
datasets
0
None public yet