This is Qwen2.5.1-Coder-3B-Instruct GGUF format model, which can be easily runned on PCs, mobile phones or devices with llama.cpp.
If you are a Mac user, the following free wonderful AI tools can help you to read and understand PDFs effectively:
If you are using Zotero for managing and reading your personal PDFs, ZoteroChat is a free plugin which can assist you to chat PDFs effectively by your local SmolLM2-135M-Instruct.
you can directly download the beautiful ChatPDFLocal MacOS app from here, load one or batch PDF files at will, and quickly experience the effect of the model through chat reading. PS. Click here to subscribe or invite friends in ChatPDFLocal MacOS app can earn credits to use freely.
Downloads last month
69
GGUF
Model size
3.09B params
Architecture
qwen2
8-bit
16-bit
Inference API
Unable to determine this model's library. Check the
docs
.