yasserrmd
/

SmallThinker-3B-Preview-gguf

Inference Endpoints

Model card Files Files and versions Community

README.md exists but content is empty.

Downloads last month: 65

GGUF

Model size

3.4B params

Architecture

qwen2

2-bit

8-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for yasserrmd/SmallThinker-3B-Preview-gguf

Base model

Qwen/Qwen2.5-3B

Finetuned

Qwen/Qwen2.5-3B-Instruct

Finetuned

PowerInfer/SmallThinker-3B-Preview

Quantized

(21)

this model