Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
relaxml
's Collections
QuIP# Quantized Models
QTIP Quantized Models
QTIP Quantized Models
updated
Dec 9, 2024
See https://github.com/Cornell-RelaxML/qtip
Upvote
11
+1
relaxml/Llama-2-7b-QTIP-4Bit
Updated
Oct 28, 2024
•
5
•
2
relaxml/Llama-2-7b-QTIP-3Bit
Updated
Oct 28, 2024
•
14
•
1
relaxml/Llama-2-7b-chat-QTIP-3Bit
Updated
Oct 28, 2024
•
3
relaxml/Llama-2-13b-QTIP-3Bit
Updated
Oct 28, 2024
•
41
relaxml/Llama-2-13b-chat-QTIP-3Bit
Updated
Oct 28, 2024
•
2
relaxml/Llama-2-70b-QTIP-3Bit
Updated
Oct 28, 2024
•
2
relaxml/Llama-2-70b-chat-QTIP-3Bit
Updated
Oct 28, 2024
•
2
relaxml/Llama-2-7b-chat-QTIP-4Bit
Updated
Oct 28, 2024
•
4
relaxml/Llama-2-13b-QTIP-4Bit
Updated
Oct 28, 2024
•
3
relaxml/Llama-2-13b-chat-QTIP-4Bit
Updated
Oct 28, 2024
•
9
relaxml/Llama-2-70b-QTIP-4Bit
Updated
Oct 28, 2024
•
2
relaxml/Llama-2-70b-chat-QTIP-4Bit
Updated
Oct 28, 2024
•
3
relaxml/Llama-2-70b-chat-QTIP-2Bit
Updated
Oct 28, 2024
•
3
relaxml/Llama-2-70b-QTIP-2Bit
Updated
Oct 28, 2024
•
6
relaxml/Llama-2-13b-chat-QTIP-2Bit
Updated
Oct 28, 2024
•
2
relaxml/Llama-2-13b-QTIP-2Bit
Updated
Oct 28, 2024
•
5
relaxml/Llama-2-7b-QTIP-2Bit
Updated
Oct 29, 2024
•
84
relaxml/Llama-2-7b-chat-QTIP-2Bit
Updated
Oct 28, 2024
•
2.64k
•
1
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
Updated
Oct 28, 2024
•
3
•
2
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
Updated
Oct 28, 2024
•
3
relaxml/Llama-3.1-8b-Instruct-QTIP-2Bit
Updated
Nov 4, 2024
•
269
•
1
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit
Updated
Oct 28, 2024
•
7
relaxml/Llama-3.1-405B-Instruct-QTIP-2Bit-TP8
Updated
Oct 28, 2024
•
5
•
1
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit-TP8
Updated
Oct 28, 2024
•
3
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit-TP8
Updated
Oct 28, 2024
•
6
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit
Updated
Oct 28, 2024
•
3
•
1
relaxml/Llama-3.1-405B-Instruct-QTIP-2Bit
Updated
Nov 16, 2024
•
5
•
3
relaxml/Llama-3.3-70B-Instruct-QTIP-4Bit
Updated
Dec 12, 2024
•
72
•
1
relaxml/Llama-3.3-70B-Instruct-QTIP-3Bit
Updated
Dec 12, 2024
•
8
•
1
relaxml/Llama-3.3-70B-Instruct-QTIP-2Bit
Updated
Dec 9, 2024
•
195
•
2
Upvote
11
+7
Share collection
View history
Collection guide
Browse collections