Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Spaces:
yhavinga
/
dutch-tokenizer-arena
Running

App Files Files Community
1
Fetching metadata from the HF Docker repository...
dutch-tokenizer-arena
Ctrl+K
Ctrl+K
  • 3 contributors
History: 80 commits
yhavinga's picture
yhavinga
Update requirements.txt
1a95d5b verified 6 months ago
  • css
    add compression leaderboard about 1 year ago
  • images
    update over 1 year ago
  • js
    add grok mixtral about 1 year ago
  • patcher
    add compression leaderboard about 1 year ago
  • stats
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 1 year ago
  • utils
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 1 year ago
  • vocab
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 1 year ago
  • .gitattributes
    2.32 kB
    add grok mixtral about 1 year ago
  • .gitignore
    171 Bytes
    update over 1 year ago
  • README.md
    25.5 kB
    Hack some Dutch tokenizers into it over 1 year ago
  • app.py
    565 Bytes
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 1 year ago
  • app_compression.py
    4.75 kB
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 1 year ago
  • app_playground.py
    9.81 kB
    update about 1 year ago
  • config.py
    1.72 kB
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 1 year ago
  • examples.py
    3.16 kB
    add compression leaderboard about 1 year ago
  • requirements.txt
    111 Bytes
    Update requirements.txt 6 months ago
  • util.py
    8.15 kB
    Hack some Dutch tokenizers into it over 1 year ago