Hamzah-Asadullah/GenericRPV2-4B-GGUF

This model is available on Ollama: ollama run Hamzah-Asadullah/GenericRPV2-4B

TL;DR: I publish GRP V2, which follows the same idea as GRP V1. For this, the smaller version ([4B] : 7B), I used Gemma3 4B as it provides expected performance, a good license and enough roleplaying finetunes. As a daily driver and professional envirments, it performs for expectation too ;)

Since that's what I do in my free-time, I don't get paid for it. Training stable models requires compute, you can help me buy more here ٩( ๑╹ ꇴ╹)۶

For people with a 8GB VRAM card, I recommend INT4 with a context length of 24 * 1024.
GRP V2 follows the same idea as V1, and the entire GRP series, basically: A daily-driver model with strong roleplaying abilities which would actually make it a "general" model; most models don't cover that, and if they do, they're usually highly censored. I intend to fix that.
Since I don't have a cluster to full-parameter fine-tune a model (I know of QLoRA, but stable uncensoring with good output isn't for LoRA), I merge models. Recycling n stuff.

For this merge, I browsed & tested six models (there aren't much Gemma3 4B finetunes) and ended up using three of them:

• allura-org/Gemma-3-Glitter-4B: A really good model, exceptional roleplaying performance, yet struggles with causal assisting
• mlabonne/gemma-3-4b-it-abliterated: No refusals, but not trained on "uncensored" rp, so kinda useless on its own
• kunjshah01/gemma-reasoning-genius: High-School homework

In summary, I used a bit of everything. All models are licensed under Gemma3, and are Gemma3 based. I didn't want to mess with multiple arch merging. I recommend the Gemma3 chat template.
Happy chatting!

---

XeTute Technologies

XeTute Technologies is an unofficial Pakistani organisation created by Hamzah Asadullah.

Links

HuggingFace GitHub

Buy me a Coffee Apex Webpage

Pakistan

Pakistan is a country in South-Asia known for its rich culture despite the British, its stunning landscape, and PAF (Pakistan Armed Forces), its military. Long live the Islamic Republic of Pakistan.