etemiz
/

Llama-3.1-70B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

llama.cpp version b4122

IMatrix file https://huggingface.co/bartowski/Hermes-3-Llama-3.1-70B-GGUF/blob/main/Hermes-3-Llama-3.1-70B.imatrix

Sponsored by: https://pickabrain.ai

Downloads last month: 182

GGUF

Model size

70.6B params

Architecture

llama

1-bit

2-bit

3-bit

4-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for etemiz/Llama-3.1-70B-Instruct-GGUF

Base model

meta-llama/Llama-3.1-70B

Finetuned

meta-llama/Llama-3.1-70B-Instruct

Quantized

(95)

this model