solidrust
/

dolphin-2.9.3-mistral-7B-32k-AWQ

Text Generation

4-bit precision

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

dolphin-2.9.3-mistral-7B-32k-AWQ / added_tokens.json

Suparious's picture

adding AWQ model

d64a332 verified 6 months ago

51 Bytes

	{
	"<\|im_end\|>": 32768,
	"<\|im_start\|>": 32769
	}