Hugging Face's logo

tiiuae
/
falcon-7b-instruct

Text Generation
Transformers
PyTorch
Core ML
Safetensors
English
falcon
conversational
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community
125

How is falcon able to generate indic token , when it is not trained on Indic languages. even tokenizer.json doest have any Indic tokens.

#90
by Sibadatta - opened
Discussion
Sibadatta

@sanchit-gandhi boss can you please answer this doubt.

Sign up or log in to comment