Spaces:
Running
Running
config python version
Browse files
README.md
CHANGED
|
@@ -7,6 +7,7 @@ sdk: gradio
|
|
| 7 |
sdk_version: 3.41.2
|
| 8 |
app_file: app.py
|
| 9 |
pinned: false
|
|
|
|
| 10 |
---
|
| 11 |
|
| 12 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
|
@@ -18,13 +19,18 @@ Check out the configuration reference at https://huggingface.co/docs/hub/spaces-
|
|
| 18 |
## TODO
|
| 19 |
|
| 20 |
|
| 21 |
-
|
|
|
|
| 22 |
|
| 23 |
|
| 24 |
|
| 25 |
## 统计
|
| 26 |
|
| 27 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
|
| 30 |
https://huggingface.co/spaces/yenniejun/tokenizers-languages
|
|
|
|
| 7 |
sdk_version: 3.41.2
|
| 8 |
app_file: app.py
|
| 9 |
pinned: false
|
| 10 |
+
python_version: 3.9
|
| 11 |
---
|
| 12 |
|
| 13 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
|
|
|
| 19 |
## TODO
|
| 20 |
|
| 21 |
|
| 22 |
+
- 搜索栏
|
| 23 |
+
-
|
| 24 |
|
| 25 |
|
| 26 |
|
| 27 |
## 统计
|
| 28 |
|
| 29 |
|
| 30 |
+
## vocabsize
|
| 31 |
+
|
| 32 |
+
- 增大能提到压缩率，副作用是增大计算量和内存 （getting the most out of your tokenizer for pre-training and）
|
| 33 |
+
-
|
| 34 |
|
| 35 |
|
| 36 |
https://huggingface.co/spaces/yenniejun/tokenizers-languages
|