Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

77

Full-text search

Active filters: aqlm

ISTA-DASLab/Qwen2-72B-AQLM-PV-1bit-1x16

Text Generation • Updated Jul 25, 2024 • 5

azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16

Text Generation • Updated Aug 28, 2024 • 4.13k • 13

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 7

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 26

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated Aug 28, 2024 • 13 • 8

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 24 • 3

galqiwi/Meta-Llama-3.1-8B-AQLM-2x8g8-NO-TUNE

Updated Aug 8, 2024 • 4

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf

Text Generation • Updated Aug 9, 2024 • 26 • 2

ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf

Updated Aug 16, 2024 • 13 • 3

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 14, 2024 • 10 • 17

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 17, 2024 • 544 • 46

ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 93

ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 87

ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 196

ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 95

slobers/pik3

Text Generation • Updated Nov 14, 2024 • 78

sdyy/bb

Updated Dec 20, 2024 • 3