Hugging Face's logo

roleplaiapp
/
Midnight-Miqu-70B-v1.5-i1-IQ3_XS-GGUF

Text Generation
Transformers
GGUF
70b
IQ3_XS
iq3
llama-cpp
midnight
miqu
v15
Inference Endpoints
imatrix
conversational
Model card Files Community

roleplaiapp/Midnight-Miqu-70B-v1.5-i1-IQ3_XS-GGUF

Repo: roleplaiapp/Midnight-Miqu-70B-v1.5-i1-IQ3_XS-GGUF Original Model: Midnight-Miqu-70B-v1.5-i1 Quantized File: Midnight-Miqu-70B-v1.5.i1-IQ3_XS.gguf Quantization: GGUF Quantization Method: IQ3_XS

Overview

This is a GGUF IQ3_XS quantized version of Midnight-Miqu-70B-v1.5-i1

Quantization By

I often have idle GPUs while building/testing for the RP app, so I put them to use quantizing models. I hope the community finds these quantizations useful.

Andrew Webby @ RolePlai.

Downloads last month
24
GGUF
Model size
69B params
Architecture
llama
View all files
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.