cognitivecomputations
/

Dolphin3.0-Llama3.1-8B-GGUF

Inference Endpoints

Model card Files Files and versions Community

Dolphin3.0-Llama3.1-8B-GGUF / quant_sizes

ehartford's picture

Upload folder using huggingface_hub

17529cc verified 8 days ago

history blame contribute delete

98 Bytes

	Q4_0
	Q4_1
	Q5_0
	Q5_1
	Q2_K
	Q3_K
	Q3_K_S
	Q3_K_M
	Q3_K_L
	Q4_K
	Q4_K_S
	Q4_K_M
	Q5_K
	Q5_K_S
	Q5_K_M
	Q6_K
	Q8_0