stan-hua/Qwen2-7B-LC-SmoothQuant-RTN-W4A16
Updated
•
4
Edit Models filters
Inference Providers
Active filters:
compressed-tensors
stan-hua/Qwen2-7B-LC-RTN-W8A8
Updated
•
4
stan-hua/Qwen2-7B-LC-SmoothQuant-RTN-W8A8
Updated
•
4
stan-hua/Qwen2-7B-LC-RTN-W8A16
Updated
•
4
stan-hua/Qwen2-7B-LC-SmoothQuant-RTN-W8A16
Updated
•
5
stan-hua/Qwen2-7B-Instruct-LC-SmoothQuant-RTN-W4A16
Updated
•
4
stan-hua/Qwen2-7B-Instruct-LC-SmoothQuant-RTN-W8A16
Updated
•
4
stan-hua/Qwen2-72B-LC-RTN-W4A16
Updated
•
5
alpindale/Magnum-Picaro-0.7-v2-12b-W8A8-Dynamic-Per-Token
Updated
•
6
nexa-collaboration/output_llama3.2_1b_2of4_stage_finetuning
Updated
•
9
nexa-collaboration/output_llama3.2_1b_2of4_stage_quantization
Updated
•
9
nexa-collaboration/output_llama3-2_1b_2of4_ckpt
Text Generation
•
Updated
•
9
soprasteria/Phi-3.5-vision-instruct-FP8-KV
Updated
•
218
IntervitensInc/Molmo-7B-D-0924-FP8-Dynamic
Updated
•
7
Lekhansh/Llama-3.2-3B-Instruct-combinedTask-extraData-overtrained-merged-W8A8-Dynamic-Per-Token
Updated
•
18
otherhalf-dev/Qwen2-VL-72B-Instruct-abliterated-FP8
Updated
•
4
nm-testing/llama-2-7b-sparse2of4
Updated
•
6
BigHuggyD/KaraKaraWitch_Llama-MiraiFanfare-2-3.3-70B-FP8-Dynamic
Text Generation
•
Updated
•
16
alpindale/magnum-v2-12b-FP8
Updated
•
141
NeoChen1024/Dolphin3.0-Llama3.1-8B-W8A8
Updated
•
7
NeoChen1024/dolphin-2.9.3-mistral-7B-32k-W8A8
Updated
•
7
NeoChen1024/Dolphin3.0-Llama3.1-8B-FP8_DYNAMIC
Updated
•
8
xiaoxixiaoxi/Qwen2.5-32B-Instruct-quantized_w4a16_wy
Updated
•
147
nm-testing/DeepSeek-V2.5-1210-quantized.w4a16
Updated
•
8
neuralmagic/granite-3.1-2b-instruct-FP8-dynamic
Text Generation
•
Updated
•
39
neuralmagic/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
•
Updated
•
167
•
1
neuralmagic/granite-3.1-2b-instruct-quantized.w8a8
Text Generation
•
Updated
•
96
neuralmagic/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
•
Updated
•
168
nm-testing/granite-3.1-3b-a800m-instruct-w4a16
Updated
•
7
ajinkya-tejankar/Llama-3.1-8B-Instruct-FP8-Dynamic
Updated
•
7