Lance's picture

25 5

Lance

clevnumb

·

AI & ML interests

None yet

Recent Activity

new activity 14 days ago

TheDrummer/Cydonia-22B-v1.3:What context size when using a 24GB VRAM card (4090) is best?

View all activity

Organizations

None yet

clevnumb's activity

New activity in TheDrummer/Cydonia-22B-v1.3 14 days ago

What context size when using a 24GB VRAM card (4090) is best?

#1 opened 14 days ago by

New activity in anthracite-org/magnum-v2-32b-exl2 5 months ago

Which Quant of this model will fit in VRAM entirely on a single 24GB video card (4090)

#1 opened 5 months ago by

New activity in NeverSleep/Lumimaid-v0.2-12B 5 months ago

My alternate quantizations.

#3 opened 5 months ago by

liked a model 5 months ago

black-forest-labs/FLUX.1-schnell

Text-to-Image • Updated Aug 16 • 870k • • 3.1k

New activity in bullerwins/Big-Tiger-Gemma-27B-v1-exl2_5.0bpw 5 months ago

Not loading in Latest Tabby (with SillyTavern) - ERROR

#2 opened 5 months ago by

New activity in BigHuggyD/alpindale_magnum-72b-v1_exl2_4.0bpw_h8 6 months ago

what quant should I use to use this with a single 24GB video card (PC) (4090 card)?

#2 opened 6 months ago by

New activity in bartowski/WizardLM-2-8x22B-GGUF 6 months ago

which quaint to I use to fit on a single 24GB video card on a PC Running Windows 11? (4090)

#3 opened 6 months ago by

liked a model 6 months ago

benk04/Typhon-Mixtral-v1-3.75bpw-h6-exl2

Text Generation • Updated Jun 2 • 8 • 3

New activity in AzureBlack/PsyMedRP-v1-20B-8bpw-8h-exl2 7 months ago

Single 4090 using OogaBooga? (Windows 11, 96GB of RAM)

#1 opened 11 months ago by

liked 2 models 8 months ago

LoneStriker/laser-dolphin-mixtral-2x7b-dpo-8.0bpw-h8-exl2

Text Generation • Updated Jan 14 • 18 • 4

mistralai/Mixtral-8x7B-v0.1

Text Generation • Updated Jul 24 • 2.97M • 1.66k

New activity in jondurbin/bagel-20b-v04 8 months ago

How do I load this in OogaBooga? (text-generation-webui)

#1 opened 8 months ago by

New activity in Wanlau/RVC_datealive 9 months ago

Where do I install these in my install of RVC Webui to they show up as 'inferencing voice' options to select? Somewhere in ASSETS folder? Where?

#1 opened 9 months ago by

New activity in LoneStriker/miquella-120b-3.0bpw-h6-exl2 9 months ago

Will any 120b model currently fit on a single 24GB VRAM card through any app I can run on PC? (aka 4090)

#1 opened 11 months ago by

New activity in supersonic013/Promptmaster-mistral-7b-GGUF 9 months ago

What is the difference between this model and Electrofried/Promptmaster-Mistral-7B-v1-GGUF (which is larger, but older)

#1 opened 9 months ago by

New activity in h94/IP-Adapter-FaceID 10 months ago

Are there safetensor files for the models?

#37 opened 11 months ago by

New activity in LoneStriker/goliath-120b-2.18bpw-h6-exl2 10 months ago

Will this fit on a single 24GB Video card (4090)?

#2 opened 10 months ago by

New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 10 months ago

Any way to speed up generation on a Windows 11 PC, using a single 24GB card (4090), with Text-Generation-WebUI

#2 opened 10 months ago by

New activity in miqudev/miqu-1-70b 10 months ago

Any chance anyone is quantizing this into a 2.4bpw EXL2 version for those of us with a single 24GB video cards?

#30 opened 10 months ago by

New activity in TeeZee/Kyllene-57B-v1.0-bpw3.0-h6-exl2 11 months ago

Glacially slow on a RTX 4090??

#1 opened 11 months ago by