Edit Models filters

Model Tree

ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

4

Full-text search

Active filters: ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

PrunaAI/ISTA-DASLab-Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16-QUANTO-int4bit-smashed

Updated Jul 20, 2024

PrunaAI/ISTA-DASLab-Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16-QUANTO-int2bit-smashed

Updated Jul 20, 2024

PrunaAI/ISTA-DASLab-Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16-QUANTO-float8bit-smashed

Updated Jul 20, 2024

PrunaAI/ISTA-DASLab-Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16-QUANTO-int8bit-smashed

Updated Jul 20, 2024