macrogpt-tokenizer / README.md
Macropodus's picture
Update README.md
ff88cd9
|
raw
history blame
228 Bytes
metadata
license: apache-2.0
language:
  - zh
  - en
pipeline_tag: text-generation
inference: false

explain

  • base tokenizer from baichuan-7B, this model add some maths symbol