legenduck
/

llama-3-Korean-Bllossom-70B-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

legenduck commited on Nov 8, 2024

Commit

ae726ea

·

verified ·

1 Parent(s): dd37699

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ base_model:
 pipeline_tag: text-generation
 quantized_by: legenduck
 ---
-## Llamacpp Quantizations of llama-3-Korean-Bllossom-70B(Aiming for around 40GB)
 Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b4048">b4048</a> for quantization.

 pipeline_tag: text-generation
 quantized_by: legenduck
 ---
+## Llamacpp Quantizations of llama-3-Korean-Bllossom-70B(Quantization less than 40GB)
 Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b4048">b4048</a> for quantization.