mradermacher
/

openbuddy-llama3.1-70b-v22.3-131k-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

openbuddy-llama3.1-70b-v22.3-131k-i1-GGUF

1 contributor

History: 10 commits

mradermacher's picture

uploaded from nico1

329545b verified 11 days ago

.gitattributes

2.16 kB

uploaded from nico1 11 days ago
README.md

251 Bytes

uploaded from nico1 11 days ago
imatrix.dat

24.9 MB
LFS

uploaded from nico1 11 days ago
openbuddy-llama3.1-70b-v22.3-131k.i1-IQ2_M.gguf

24.1 GB
LFS

uploaded from nico1 11 days ago
openbuddy-llama3.1-70b-v22.3-131k.i1-IQ3_M.gguf

31.9 GB
LFS

uploaded from nico1 11 days ago
openbuddy-llama3.1-70b-v22.3-131k.i1-IQ3_XXS.gguf

27.5 GB
LFS

uploaded from nico1 11 days ago
openbuddy-llama3.1-70b-v22.3-131k.i1-Q2_K.gguf

26.4 GB
LFS

uploaded from nico1 11 days ago
openbuddy-llama3.1-70b-v22.3-131k.i1-Q3_K_M.gguf

34.3 GB
LFS

uploaded from nico1 11 days ago
openbuddy-llama3.1-70b-v22.3-131k.i1-Q4_K_M.gguf

42.5 GB
LFS

uploaded from nico1 11 days ago
openbuddy-llama3.1-70b-v22.3-131k.i1-Q4_K_S.gguf

40.3 GB
LFS

uploaded from nico1 11 days ago