Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,230

Full-text search

Active filters: awq

DeL-TaiseiOzaki/Tengentoppa-11B-Instruct-awq

Text Generation • Updated Jun 9, 2024 • 6

changchuntzu/project-m2-2024-dreamteam-awq_v2

Text Generation • Updated Jun 9, 2024 • 6

aspirina765/Daredevil-8B-abliterated-AWQ

Text Generation • Updated Jun 9, 2024 • 10

nmnth/llama3_7b_lora_4bit_awq

Text Generation • Updated Jun 10, 2024 • 8

luchenyu/openbiollm-llama3-70b

Text Generation • Updated Jun 10, 2024 • 6

Weni/WeniGPT-Agents-Llama3-5.0.89-DPO-AWQ

Text Generation • Updated Jul 25, 2024 • 6

solidrust/TinyLlama-1.1B-32k-Instruct-AWQ

Text Generation • Updated Sep 3, 2024 • 6

solidrust/L3-8B-Stheno-v3.2-AWQ

Text Generation • Updated Sep 3, 2024 • 16 • 2

solidrust/UltraMerge-7B-AWQ

Text Generation • Updated Sep 3, 2024 • 12

kaitchup/Phi-3-medium-4k-instruct-awq-4bit

Text Generation • Updated Jun 21, 2024

kaitchup/Phi-3-medium-128k-instruct-awq-4bit

Text Generation • Updated Jun 21, 2024

Narednra/Meditron_llama2_7b_58k-AWQ

Text Generation • Updated Jun 11, 2024 • 8

solidrust/Average_Normie_v3.69_8B-AWQ

Text Generation • Updated Sep 3, 2024 • 8

civoai/Meta-Llama-3-8B-awq

Text Generation • Updated Jun 11, 2024 • 8

solidrust/dolphin-2.9.2-qwen2-7b-AWQ

Text Generation • Updated Sep 3, 2024 • 6

changchuntzu/project-m2-2024-dreamteam-awq_full

Text Generation • Updated Jun 11, 2024 • 6

amir-ma71/Dorna-Llama3-8B-Instruct-AWQ

Text Generation • Updated Jun 27, 2024 • 20 • 1

civoai/Meta-Llama-3-8B-Instruct-awq

Text Generation • Updated Jun 11, 2024 • 10

solidrust/Ayam-2x8B-AWQ

Text Generation • Updated Sep 3, 2024 • 6

NghiemAbe/SeaLLM-v2.5-Legal-v4-AWQ

Text Generation • Updated Jul 18, 2024 • 85

solidrust/Hathor-L3-8B-v.01-AWQ

Text Generation • Updated Sep 3, 2024 • 6

solidrust/Inixion-2x8B-AWQ

Text Generation • Updated Sep 3, 2024 • 6

solidrust/Llama-3-NeuralHercules-5.0-8B-AWQ

Text Generation • Updated Sep 3, 2024 • 6

OriDragon2000/Qwen2-0.5B-awq-w4-g128

Text Generation • Updated Jun 12, 2024 • 11

solidrust/Llama-3-8B-AWQ

Text Generation • Updated Sep 3, 2024 • 9

OriDragon2000/Qwen1.5-7B-awq-w4-g128

Text Generation • Updated Jun 12, 2024 • 9

solidrust/Hathor-L3-8B-v.02-AWQ

Text Generation • Updated Sep 3, 2024 • 21

OriDragon2000/Qwen1.5-1.8B-awq-w4-g128

Text Generation • Updated Jun 12, 2024 • 10

zaddyzaddy/Soro-GPT-4bit

Text Generation • Updated Jun 12, 2024 • 6

attention-avengers/Qwen1.5-0.5B-Chat-SFT-MCQA-AWQ

Text Generation • Updated Jun 12, 2024 • 6