Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

10,815

Full-text search

Active filters: 8-bit

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_8.0bpw_h8

Text Generation • Updated Dec 9, 2024 • 260 • 2

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • Updated Dec 6, 2024 • 3.31k • 9

jackboyla/Phi-3-mini-4k-instruct-graph-GGUF

Text Generation • Updated Dec 7, 2024 • 11 • 1

reinforce20001/SakuraLLM.Sakura-7B-Qwen2.5-v1.0-W8A8-Int8

Updated Dec 8, 2024 • 8 • 1

mlx-community/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-8-bit

Text Generation • Updated Dec 9, 2024 • 51 • 1

PrunaAI/DiatWork-GPT-Neox-MentalHealth-Finetune-10epoch-bnb-8bit-smashed

Updated Dec 10, 2024 • 5 • 1

PrunaAI/Sakalti-Saba1.5-Pro-bnb-8bit-smashed

Updated about 1 month ago • 7 • 1

PrunaAI/Sakalti-magro-7B-bnb-8bit-smashed

Updated Dec 11, 2024 • 5 • 1

PrunaAI/nqzfaizal77ai-swiftstrike-aero-init-580m-bnb-8bit-smashed

Updated about 1 month ago • 13 • 1

PrunaAI/nqzfaizal77ai-mirabel-tempest-init-570m-bnb-8bit-smashed

Updated about 1 month ago • 13 • 1

prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF

Text Generation • Updated 29 days ago • 1.34k • 10

ai-sage/GigaChat-20B-A3B-instruct-int8

Updated 28 days ago • 502 • 4

PrunaAI/prithivMLmods-QwQ-LCoT-3B-Instruct-bnb-8bit-smashed

Updated 29 days ago • 24 • 3

PrunaAI/sakaltcommunity-sakaltum-7b-bnb-8bit-smashed

Updated 29 days ago • 6 • 1

PrunaAI/sakaltcommunity-wasser-4b-bnb-8bit-smashed

Updated 29 days ago • 6 • 1

PrunaAI/EpistemeAI-Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic-bnb-8bit-smashed

Updated 29 days ago • 8 • 1

tiiuae/Falcon3-10B-Instruct-GPTQ-Int8

Updated 25 days ago • 466 • 2

tiiuae/Falcon3-3B-Instruct-GPTQ-Int8

Updated 25 days ago • 246 • 1

tiiuae/Falcon3-1B-Instruct-GPTQ-Int8

Updated 25 days ago • 197 • 1

vitekkor/T-pro-it-1.0-bnb-8bit

Updated 27 days ago • 621 • 1

PrunaAI/Sakalti-Saba1-3B-bnb-8bit-smashed

Updated 28 days ago • 5 • 1

tiiuae/Falcon3-10B-Instruct-1.58bit

Text Generation • Updated 22 days ago • 271 • 12

tiiuae/Falcon3-10B-Base-1.58bit

Text Generation • Updated 22 days ago • 108 • 4

PrunaAI/Pinkstack-PARM-V2-QwQ-Qwen-2.5-o1-3B-VLLM-bnb-8bit-smashed

Updated 26 days ago • 34 • 1

PrunaAI/romanoza-gpt2-small-III-bnb-8bit-smashed

Updated 22 days ago • 4 • 1

PrunaAI/Sakalti-saba1.5-coder-bnb-8bit-smashed

Updated 20 days ago • 4 • 1

Dracones/Anubis-70B-v1_exl2_8.0bpw

Text Generation • Updated 18 days ago • 72 • 1

PrunaAI/burgasdotpro-bgGPT-llama-3.1-8B-math-bnb-8bit-smashed

Updated 15 days ago • 6 • 1

PrunaAI/Guilherme34-Samantha-v6-bnb-8bit-smashed

Updated 12 days ago • 4 • 1

MaziyarPanahi/aya-expanse-8b-abliterated-GGUF

Text Generation • Updated 10 days ago • 177 • 1