casperhansen
/

mpt-7b-8k-chat-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

mpt-7b-8k-chat-awq / config.json

Commit History

Set initial device to cuda:0 for faster initial loading

364bcfc

casperhansen commited on Jul 27, 2023

MPT 7B 8K quantized

5c660fe

casperhansen commited on Jul 26, 2023