The QwQ-32B-preview model family, developed by Alibaba, consists of lightweight, open-source models that demonstrate state-of-the-art performance across various tasks.
This repo is about QwQ-32B-preview different size gguf models, which are very applicable for deploying and using in PCs, laptops or mobiles.
If you are a Mac user, the following free wonderful AI tools can help you to read and understand PDFs effectively:
- If you are using Zotero for managing and reading your personal PDFs, PapersGPT is a free plugin which can assist you to chat PDFs effectively by your local gemma2.
- you can download the beautiful ChatPDFLocal MacOS app from here, load one or batch PDF files at will, and quickly experience the effect of the model through chat reading.
- Downloads last month
- 355
Hardware compatibility
Log In
to view the estimation
2-bit
3-bit
4-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.