LoneStriker
/

Liberated-Miqu-70B-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Liberated Miqu 70B

Liberated Miqu 70B is a fine-tune of Miqu-70B on Abacus AI's SystemChat dataset. This model has been trained on 2xA100 GPUs for 1 epoch.

🏆 Evaluation results

Coming soon

Framework versions

Transformers 4.38.0.dev0
Pytorch 2.1.2+cu118
Datasets 2.17.0
Tokenizers 0.15.0
axolotl: 0.4.0

Downloads last month: 21

GGUF

Model size

69B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for LoneStriker/Liberated-Miqu-70B-GGUF

Base model

152334H/miqu-1-70b-sf

Quantized

(15)

this model

Dataset used to train LoneStriker/Liberated-Miqu-70B-GGUF