Edit Models filters

Inference status

Misc

arxiv: 2305.18290

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

391

Full-text search

Active filters: 2305.18290

LiteLLMs/Llama3-OpenBioLLM-70B-GGUF

Updated May 28 • 1.17k • 4

LiteLLMs/Llama3-OpenBioLLM-8B-GGUF

Updated Apr 29 • 262

RichardErkhov/HuggingFaceH4_-_zephyr-7b-alpha-4bits

Text Generation • Updated May 1

RichardErkhov/HuggingFaceH4_-_zephyr-7b-alpha-8bits

Text Generation • Updated May 1

RichardErkhov/HuggingFaceH4_-_zephyr-7b-alpha-gguf

Updated May 1 • 147

RichardErkhov/HuggingFaceH4_-_zephyr-7b-beta-4bits

Text Generation • Updated May 1 • 12

RichardErkhov/HuggingFaceH4_-_zephyr-7b-beta-8bits

Text Generation • Updated May 1

RichardErkhov/HuggingFaceH4_-_zephyr-7b-beta-gguf

Updated May 1 • 112 • 1

RichardErkhov/aaditya_-_Llama3-OpenBioLLM-8B-4bits

Text Generation • Updated May 1 • 11

RichardErkhov/aaditya_-_Llama3-OpenBioLLM-8B-8bits

Text Generation • Updated May 1 • 6

YeungNLP/firefly-qwen1.5-en-7b-unsloth

Text Generation • Updated May 5 • 8 • 2

RichardErkhov/stabilityai_-_stablelm-2-zephyr-1_6b-4bits

Text Generation • Updated May 3

RichardErkhov/stabilityai_-_stablelm-2-zephyr-1_6b-8bits

Text Generation • Updated May 3

YeungNLP/firefly-qwen1.5-en-7b-dpo-v0.1-unsloth

Text Generation • Updated May 5 • 6 • 2

MoMonir/Llama3-OpenBioLLM-8B-GGUF

Updated May 4 • 86 • 1

blockblockblock/Llama3-OpenBioLLM-70B-bpw4-exl2

Text Generation • Updated May 4 • 10

RichardErkhov/stabilityai_-_stablelm-zephyr-3b-4bits

Text Generation • Updated May 4 • 2

RichardErkhov/stabilityai_-_stablelm-zephyr-3b-8bits

Text Generation • Updated May 4 • 2

RichardErkhov/stabilityai_-_stablelm-zephyr-3b-gguf

Updated May 4 • 91

NicholasJohn/OpenBioLLM-Llama3-8B-Q5_K_M.gguf

Updated May 7 • 14 • 1

blockblockblock/Llama3-TenyxChat-70B-bpw2.25-exl2

Text Generation • Updated May 9 • 4

blockblockblock/Llama3-TenyxChat-70B-bpw2.5-exl2

Text Generation • Updated May 9 • 3

blockblockblock/Llama3-TenyxChat-70B-bpw3-exl2

Text Generation • Updated May 9 • 4

blockblockblock/Llama3-TenyxChat-70B-bpw3.5-exl2

Text Generation • Updated May 10 • 6

blockblockblock/Llama3-TenyxChat-70B-bpw3.7-exl2

Text Generation • Updated May 10 • 3

blockblockblock/Llama3-TenyxChat-70B-bpw4-exl2

Text Generation • Updated May 10 • 4

blockblockblock/Llama3-TenyxChat-70B-bpw4.2-exl2

Text Generation • Updated May 10 • 2

fakezeta/Llama3-OpenBioLLM-8B-ov-int8

Text Generation • Updated May 10 • 14

blockblockblock/Llama3-TenyxChat-70B-bpw4.4-exl2

Text Generation • Updated May 10 • 2

blockblockblock/Llama3-TenyxChat-70B-bpw4.6-exl2

Text Generation • Updated May 10 • 5