File size: 437 Bytes
825cfb0 9382e3f 825cfb0 9382e3f 825cfb0 9382e3f |
1 2 3 4 5 6 7 8 9 10 11 12 13 |
---
title: 1-Bit Llama-3 Demo Batch Input/Output 500+ Tokens per Second by xMAD.ai
emoji: 💬
colorFrom: yellow
colorTo: purple
sdk: gradio
sdk_version: 4.36.1
app_file: app.py
pinned: false
license: llama3
---
An example chatbot using [Gradio](https://gradio.app), [`huggingface_hub`](https://huggingface.co/docs/huggingface_hub/v0.22.2/en/index), and the [Hugging Face Inference API](https://huggingface.co/docs/api-inference/index). |