N_ctx = 0 causes to use a lot of vram
3
#4 opened 23 days ago
by
Nandobob23
Chat template
3
#3 opened 5 months ago
by
sydneyfong
Works good generating python on my 64GB RAM w/ 3090TI 24GB VRAM dev box
3
#2 opened 5 months ago
by
ubergarm
Can you please provide the command to change the context size?
5
#1 opened 5 months ago
by
yehiaserag