relaxml/Llama-2-7b-QTIP-4Bit
Updated
•
1
QTIP Quantized Models
See https://github.com/Cornell-RelaxML/qtip
-
-
relaxml/Llama-2-7b-QTIP-3Bit
Updated • 57 -
relaxml/Llama-2-7b-chat-QTIP-3Bit
Updated • 2 -
relaxml/Llama-2-13b-QTIP-3Bit
Updated • 3 -
relaxml/Llama-2-13b-chat-QTIP-3Bit
Updated • 5 -
relaxml/Llama-2-70b-QTIP-3Bit
Updated • 3 -
relaxml/Llama-2-70b-chat-QTIP-3Bit
Updated • 3 -
relaxml/Llama-2-7b-chat-QTIP-4Bit
Updated • 3 -
relaxml/Llama-2-13b-QTIP-4Bit
Updated • 2 -
relaxml/Llama-2-13b-chat-QTIP-4Bit
Updated • 3 -
relaxml/Llama-2-70b-QTIP-4Bit
Updated • 5 -
relaxml/Llama-2-70b-chat-QTIP-4Bit
Updated • 4 -
relaxml/Llama-2-70b-chat-QTIP-2Bit
Updated • 2 -
relaxml/Llama-2-70b-QTIP-2Bit
Updated • 4 -
relaxml/Llama-2-13b-chat-QTIP-2Bit
Updated -
relaxml/Llama-2-13b-QTIP-2Bit
Updated • 37 -
relaxml/Llama-2-7b-QTIP-2Bit
Updated • 196 -
relaxml/Llama-2-7b-chat-QTIP-2Bit
Updated • 4 -
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
Updated • 4 -
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
Updated • 4 -
relaxml/Llama-3.1-8b-Instruct-QTIP-2Bit
Updated • 4 -
relaxml/Llama-3.1-8b-QTIP-3Bit
Updated • 6 -
relaxml/Llama-3.1-8b-QTIP-4Bit
Updated • 6 -
relaxml/Llama-3.1-8b-QTIP-2Bit
Updated • 6