Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Rombos-LLM-V2.5-Qwen-7b-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
9322340
Rombos-LLM-V2.5-Qwen-7b-GGUF
1 contributor
History:
5 commits
MaziyarPanahi
7b1ddc9f702410c00ca316512eac70d37803570db81bb707615211d508975b2e
9322340
verified
about 2 months ago
.gitattributes
Safe
1.8 kB
7b1ddc9f702410c00ca316512eac70d37803570db81bb707615211d508975b2e
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b.Q5_K_M.gguf
Safe
5.44 GB
LFS
3ebdb6af23b49f6ad5f070f8de30d0859c5fc0ed3d7fb3c691f8a278f1c310bb
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b.Q5_K_S.gguf
Safe
5.32 GB
LFS
c8aa086ad13d9879d857b0236d3d8d5bea7e3bda656c1af8adb892bf0ead0d44
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b.Q6_K.gguf
Safe
6.25 GB
LFS
01022f08b9b9e62d6368b39a0eb99100a46cf62bdd889cfe24ea79ecc1e657af
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b.Q8_0.gguf
Safe
8.1 GB
LFS
7b1ddc9f702410c00ca316512eac70d37803570db81bb707615211d508975b2e
about 2 months ago