dusty-nv
/

DeepSeek-R1-Distill-Llama-8B-q4f16_ft-MLC

dusty-nv commited on Jan 29

Commit

2b008ce

verified ·

1 Parent(s): 2128956

Upload folder using huggingface_hub

Files changed (1) hide show

README.md CHANGED Viewed

@@ -11,9 +11,9 @@
 | Prefill Chunk Size  |                                                    `8192`                                                     |
 | Temperature         |                                                     `0.6`                                                     |
 | Repetition Penalty  |                                                     `1.0`                                                     |
-| `top_p`             |                                                    `0.95`                                                     |
-| `pad_token_id`      |                                                      `0`                                                      |
-| `bos_token_id`      |                                                   `128000`                                                    |
-| `eos_token_id`      |                                                   `128001`                                                    |
 See [`jetson-ai-lab.com/models.html`](https://jetson-ai-lab.com/models.html) for benchmarks, examples, and containers to deploy local serving and inference for these quantized models.

 | Prefill Chunk Size  |                                                    `8192`                                                     |
 | Temperature         |                                                     `0.6`                                                     |
 | Repetition Penalty  |                                                     `1.0`                                                     |
+| top_p               |                                                    `0.95`                                                     |
+| pad_token_id        |                                                      `0`                                                      |
+| bos_token_id        |                                                   `128000`                                                    |
+| eos_token_id        |                                                   `128001`                                                    |
 See [`jetson-ai-lab.com/models.html`](https://jetson-ai-lab.com/models.html) for benchmarks, examples, and containers to deploy local serving and inference for these quantized models.