Reducing default max new tokens to speed up responses on CPU 434becc Running abrakjamson commited on Oct 14
Implementing streaming chat, moving models, generalizing preset buttons f7a1bd4 abrakjamson commited on Oct 6