Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MarsupialAI
/
Llama-3.1-Nemotron-70B-Instruct_iMat_GGUF
like
2
Text Generation
Transformers
GGUF
nvidia/HelpSteer2
English
nvidia
llama3.1
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.1-Nemotron-70B-Instruct_iMat_GGUF
1 contributor
History:
17 commits
MarsupialAI
Upload 2 files
de7e58c
verified
2 months ago
.gitattributes
Safe
3.25 kB
Upload 2 files
2 months ago
Llama-3.1-Nemotron-70B-Instruct-imatrix.dat
24.9 MB
LFS
Upload 2 files
2 months ago
Llama-3.1-Nemotron-70B-Instruct_Q3km.gguf
Safe
34.3 GB
LFS
Upload Llama-3.1-Nemotron-70B-Instruct_Q3km.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_Q4km.gguf
Safe
42.5 GB
LFS
Upload Llama-3.1-Nemotron-70B-Instruct_Q4km.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_Q4ks.gguf
Safe
40.3 GB
LFS
Upload Llama-3.1-Nemotron-70B-Instruct_Q4ks.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_Q5km.gguf-00001-of-00002.gguf
Safe
44.9 GB
LFS
Upload Llama-3.1-Nemotron-70B-Instruct_Q5km.gguf-00001-of-00002.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_Q5km.gguf-00002-of-00002.gguf
Safe
5.01 GB
LFS
Upload Llama-3.1-Nemotron-70B-Instruct_Q5km.gguf-00002-of-00002.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_Q5ks.gguf
Safe
48.7 GB
LFS
Upload Llama-3.1-Nemotron-70B-Instruct_Q5ks.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_Q6k.gguf-00001-of-00002.gguf
Safe
45 GB
LFS
Upload Llama-3.1-Nemotron-70B-Instruct_Q6k.gguf-00001-of-00002.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_Q6k.gguf-00002-of-00002.gguf
Safe
12.9 GB
LFS
Upload Llama-3.1-Nemotron-70B-Instruct_Q6k.gguf-00002-of-00002.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_fp16-00001-of-00004.gguf
Safe
44.9 GB
LFS
Rename Llama-3.1-Nemotron-70B-Instruct_fp16.gguf-00001-of-00004.gguf to Llama-3.1-Nemotron-70B-Instruct_fp16-00001-of-00004.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_fp16-00002-of-00004.gguf
Safe
45 GB
LFS
Upload 3 files
2 months ago
Llama-3.1-Nemotron-70B-Instruct_fp16-00003-of-00004.gguf
Safe
44.7 GB
LFS
Upload 3 files
2 months ago
Llama-3.1-Nemotron-70B-Instruct_fp16-00004-of-00004.gguf
Safe
6.6 GB
LFS
Upload 3 files
2 months ago
Llama-3.1-Nemotron-70B-Instruct_iQ2m.gguf
Safe
24.1 GB
LFS
Upload Llama-3.1-Nemotron-70B-Instruct_iQ2m.gguf
2 months ago
Llama-3.1-Nemotron-70B-Instruct_iQ2xxs.gguf
Safe
19.1 GB
LFS
Upload 3 files
2 months ago
Llama-3.1-Nemotron-70B-Instruct_iQ3m.gguf
Safe
31.9 GB
LFS
Upload 3 files
2 months ago
Llama-3.1-Nemotron-70B-Instruct_iQ3xxs.gguf
Safe
27.5 GB
LFS
Upload 3 files
2 months ago
Llama-3.1-Nemotron-70B-Instruct_iQ4nl.gguf
Safe
40.1 GB
LFS
Upload 2 files
2 months ago
Llama-3.1-Nemotron-70B-Instruct_iQ4xs.gguf
Safe
37.9 GB
LFS
Upload 2 files
2 months ago
README.md
Safe
369 Bytes
Create README.md
2 months ago
groups_merged.txt
Safe
201 kB
Upload 2 files
2 months ago
