Update README.md
Browse files
README.md
CHANGED
@@ -2,6 +2,8 @@
|
|
2 |
|
3 |
Quantized starcoderbase-3b model to GPTQ format (4-bit precision).
|
4 |
|
|
|
|
|
5 |
## Benchmark
|
6 |
|
7 |
[Benchmarking script](https://github.com/cosmo3769/Quantized-LLMs/blob/main/notebooks/llmbenchmark-starcodebase-3b-lm-eval-harness.ipynb)
|
|
|
2 |
|
3 |
Quantized starcoderbase-3b model to GPTQ format (4-bit precision).
|
4 |
|
5 |
+
[Quantization script](https://github.com/cosmo3769/Quantized-LLMs/blob/main/notebooks/quantize-starcodebase-3b-gptq.ipynb)
|
6 |
+
|
7 |
## Benchmark
|
8 |
|
9 |
[Benchmarking script](https://github.com/cosmo3769/Quantized-LLMs/blob/main/notebooks/llmbenchmark-starcodebase-3b-lm-eval-harness.ipynb)
|