nm-testing/llama2.c-stories110M-gsm8k-recipe_w4a16_actorder_weight-compressed
Updated
•
62
Edit Models filters
Inference Providers
Active filters:
compressed-tensors
nm-testing/llama2.c-stories110M-gsm8k-fp8_dynamic-compressed
Updated
•
62
nm-testing/whisper-large-v3-quantized.w8a8
Updated
•
37
nm-testing/whisper-large-v3-quantized.w8a8_sq
Updated
•
51
noneUsername/reka-flash-3-W8A8
Updated
•
14
nm-testing/whisper-large-v3-quantized.w4a16
Updated
•
11
Armaan11/deepseek-r1-distill-qwen-7b_s
Updated
•
2
Armaan11/deepseek-r1-distill-qwen-32b_s
Updated
•
6
Armaan11/deepseek-r1-distill-qwen-14b_s
Updated
•
5
ospatch/QwQ-32B-INT8-W8A8
Text Generation
•
Updated
•
28
qingy2024/DeepHermes-3-Mistral-24B-Preview-FP8-dynamic
Text Generation
•
Updated
•
24
noneUsername/Forgotten-Safeword-24B-V3.0-W8A8
Updated
•
8
duydq12/Qwen2.5-Coder-14B-Instruct-FP8-dynamic
Updated
•
3
duydq12/Qwen2.5-Coder-7B-Instruct-FP8-dynamic
Updated
•
19
noneUsername/Mistral-Small-24B-Instruct-2501-writer-W8A8-better
Updated
•
4
nm-testing/Qwen2-VL-2B-Instruct-FP8_DYNAMIC
Image-Text-to-Text
•
Updated
•
15
nm-testing/Qwen2-VL-2B-Instruct-FP8-dynamic-cli
Updated
•
9
aikitoria/c4ai-command-a-03-2025-FP8-Dynamic
Updated
•
4
mrhendrey/X-ALMA-13B-Pretrain-FP8-dynamic
Updated
BigHuggyD/SteelSkull_L3.3-Electra-R1-70b-FP8-Dynamic
Text Generation
•
Updated
T145/ZEUS-8B-V22-W8A8-INT8
Updated
nm-testing/Llama-3.1-8B-Instruct-W4A16-G128-shared-pipeline
Updated