TeeZee/2xbagel-dpo-34b-v0.2-bpw3.0-h6-exl2
Text Generation
•
Updated
•
14
•
1
24 GB VRAM
Quants that run fast on single 3090/4090 card with 24GB of VRAM and 4096 context length
-
-
TeeZee/2xNous-Capybara-34B-bpw3-h6-exl2
Text Generation • Updated • 18 -
TeeZee/Psyfighter2-Orca2-13B-ties-bpw8.0-h8-exl2
Text Generation • Updated • 18 -
TeeZee/chronomaid-storytelling-13B-bpw8.0-h8-exl2
Text Generation • Updated • 20 -
TeeZee/Fimbulvetr-10.7B-v1-bpw8.0-h8-exl2
Text Generation • Updated • 21 -
TeeZee/Kyllene-57B-v1.0-bpw3.0-h6-exl2
Text Generation • Updated • 10 -
TeeZee/Xwin-LM-70B-V0.1_Limarpv3-bpw2.4-h6
Text Generation • Updated • 18 -
TeeZee/DarkForest-20B-v1.0-bpw8.0-h8-exl2
Text Generation • Updated • 14 • 1 -
TeeZee/BigMaid-20B-v1.0-bpw8.0-h8-exl2
Text Generation • Updated • 12 • 1 -
TeeZee/DarkForest-20B-v2.0-bpw8.0-h8-exl2
Text Generation • Updated • 9 • 1 -
TeeZee/DarkForest-20B-v2.0-bpw6.0-h6-exl2
Text Generation • Updated • 8 -
TeeZee/DarkForest-20B-v2.0-bpw6.0-h8-exl2
Text Generation • Updated • 8 -
TeeZee/NEBULA-23.8B-v1.0-bpw7.5-h8-exl2
Text Generation • Updated • 7 -
TeeZee/GALAXY-16B-v1.0-bpw8.0-h8-exl2
Text Generation • Updated • 7 -
TeeZee/BigMaid-20B-v2.0-bpw8.0-h8-exl2
Text Generation • Updated • 10 -
TeeZee/DarkForest-20B-v3.0-bpw8.0-h8-exl2
Text Generation • Updated • 10 -
TeeZee/2xbagel-dpo-34b-v0.2-bpw2.8-h6-exl2
Updated • 3 -
TeeZee/2xbagel-34b-v0.2-bpw2.8-h6-exl2
Text Generation • Updated • 8