📟 Relay v0.1 (Mistral Nemo 2407): 8-bit (bnb)

This model page includes the 8-bit bitsandbytes version of relay-v0.1-Mistral-Nemo-2407. For more details about the model, and how it should be used, please see that model page.

Downloads last month: 10

Safetensors

Model size

12.2B params

Tensor type

F32

FP16

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Base model

mistralai/Mistral-Nemo-Base-2407

Finetuned

danlou/relay-v0.1-Mistral-Nemo-2407

Quantized

(4)

this model

Dataset used to train danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Collection including danlou/relay-v0.1-Mistral-Nemo-2407-8bit

📟 Relay

Collection

Turning base LLMs into IRCs, for more natural and versatile chat applications. • 5 items • Updated 12 days ago