Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Vi-Qwen2-7B-RAG-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Vi-Qwen2-7B-RAG-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
cc299edc88425d139de080220e7c6de591f4ea2988c10e0af7900523a5b1568d
11ad257
verified
3 months ago
.gitattributes
Safe
1.9 kB
cc299edc88425d139de080220e7c6de591f4ea2988c10e0af7900523a5b1568d
3 months ago
README.md
Safe
2.93 kB
cc299edc88425d139de080220e7c6de591f4ea2988c10e0af7900523a5b1568d
3 months ago
Vi-Qwen2-7B-RAG-GGUF_imatrix.dat
4.54 MB
LFS
cc299edc88425d139de080220e7c6de591f4ea2988c10e0af7900523a5b1568d
3 months ago
Vi-Qwen2-7B-RAG.Q5_K_M.gguf
5.44 GB
LFS
4a32ccfb53b384b5105a44bdb5e617edd81dc1642bdb7ca4d58639817496d32d
3 months ago
Vi-Qwen2-7B-RAG.Q5_K_S.gguf
5.32 GB
LFS
9785da38b58236636faec0b63f4de725eedd2ec874ad8abb1553957b5c0675f6
3 months ago
Vi-Qwen2-7B-RAG.Q6_K.gguf
6.25 GB
LFS
dd7d925d7ee58d41652b3ebb8093082b79a8dd83a476239868c9e691680aa3af
3 months ago
Vi-Qwen2-7B-RAG.Q8_0.gguf
8.1 GB
LFS
f4422da7bbfd3a8d2a46b94e1cfb01472bf8e30a5e4b752731e8c50238e3dbd8
3 months ago
Vi-Qwen2-7B-RAG.fp16.gguf
15.2 GB
LFS
221a9cfa6e17dfab22803629774d0d499b9b4dbbf2c1ae165c76d17409739e1c
3 months ago
