Ollama-ready Coding Models - a onekq-ai Collection

onekq-ai 's Collections

Ollama-ready Coding Models

QLora-ready Coding Models

Ollama-ready Coding Models

updated 21 days ago

For inference. CPU is enough for both quantization and inference.

QuantFactory/OpenCoder-8B-Instruct-GGUF

Text Generation • Updated Nov 9, 2024 • 301 • 6
QuantFactory/OpenCoder-8B-Base-GGUF

Text Generation • Updated Nov 9, 2024 • 130 • 3
bartowski/starcoder2-15b-instruct-GGUF

Text Generation • Updated Mar 6, 2024 • 450 • 2
QuantFactory/starcoder2-15b-GGUF

Text Generation • Updated Sep 6, 2024 • 97 • 2
bartowski/starcoder2-15b-instruct-v0.1-GGUF

Text Generation • Updated Apr 30, 2024 • 358 • 6
bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 20, 2024 • 59.5k • 94
QuantFactory/starcoder2-7b-instruct-GGUF

Text Generation • Updated Oct 18, 2024 • 140 • 1
QuantFactory/starcoder2-7b-GGUF

Text Generation • Updated Sep 5, 2024 • 125 • 2
QuantFactory/starcoder2-3b-instruct-v0.1-GGUF

Updated Oct 18, 2024 • 61 • 1
QuantFactory/starcoder2-3b-instruct-GGUF

Text Generation • Updated Oct 18, 2024 • 69 • 1
QuantFactory/starcoder2-3b-GGUF

Text Generation • Updated Sep 5, 2024 • 466 • 3
Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated 24 days ago • 141k • 128
bartowski/Qwen2.5-Coder-32B-GGUF

Text Generation • Updated Nov 11, 2024 • 1.81k • 14
Qwen/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 85.2k • 39
mradermacher/Qwen2.5-14B-Coder-Merge-GGUF

Updated about 1 month ago • 429 • 2
Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 20.7k • 50
QuantFactory/Qwen2.5-Coder-7B-GGUF

Text Generation • Updated Sep 19, 2024 • 523 • 3
Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 12.5k • 29
QuantFactory/Qwen2.5-Coder-1.5B-GGUF

Text Generation • Updated Sep 19, 2024 • 264 • 2
QuantFactory/DeepSeek-Coder-V2-Lite-Base-GGUF

Text Generation • Updated Jun 24, 2024 • 514 • 1
ibm-granite/granite-34b-code-instruct-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 133 • 2
ibm-granite/granite-34b-code-base-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 21 • 3
ibm-granite/granite-20b-code-instruct-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 60 • 5
ibm-granite/granite-20b-code-base-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 20 • 4
QuantFactory/granite-8b-code-instruct-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 110 • 3
RichardErkhov/ibm-granite_-_granite-8b-code-base-128k-gguf

Updated Aug 22, 2024 • 147
ibm-granite/granite-8b-code-instruct-4k-GGUF

Text Generation • Updated Sep 2, 2024 • 1.31k • 10
ibm-granite/granite-8b-code-base-4k-GGUF

Text Generation • Updated Sep 2, 2024 • 27 • 2
mradermacher/granite-3b-code-instruct-128k-GGUF

Updated Dec 29, 2024 • 58
QuantFactory/granite-3b-code-base-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 99 • 2
ibm-granite/granite-3b-code-instruct-2k-GGUF

Text Generation • Updated Sep 2, 2024 • 54 • 5
ibm-granite/granite-3b-code-base-2k-GGUF

Text Generation • Updated Sep 2, 2024 • 57 • 2