error in webui
#3
by
prosh
- opened
Mismatch in names. You've told UI to load koala-13B but you have downloaded 7B
Sorry, I just realised that was my fault! The README had the wrong code. I have fixed it now.
Correct command to launch the UI:
python server.py --model koala-7B-GPTQ-4bit-128g --wbits 4 --groupsize 128 --model_type Llama # add any other command line args you want