This model is copied from https://huggingface.co/yuhuili/EAGLE3-LLaMA3.1-Instruct-8B with the following modifications to make it compatible with SGLang:

  • Modify the architecture in config.json to LlamaForCausalLMEagle3
Downloads last month
6,643
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support