uploaded readme

README.md

@@ -0,0 +1,96 @@
+Quantization made by Richard Erkhov.
+
+[Github](https://github.com/RichardErkhov)
+
+[Discord](https://discord.gg/pvy7H8DZMG)
+
+[Request more models](https://github.com/RichardErkhov/quant_request)
+
+
+MeowGPT-3.5 - GGUF
+- Model creator: https://huggingface.co/cutycat2000x/
+- Original model: https://huggingface.co/cutycat2000x/MeowGPT-3.5/
+
+
+| Name | Quant method | Size |
+| ---- | ---- | ---- |
+| [MeowGPT-3.5.Q2_K.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q2_K.gguf) | Q2_K | 2.53GB |
+| [MeowGPT-3.5.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q3_K_S.gguf) | Q3_K_S | 2.95GB |
+| [MeowGPT-3.5.Q3_K.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q3_K.gguf) | Q3_K | 3.28GB |
+| [MeowGPT-3.5.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q3_K_M.gguf) | Q3_K_M | 3.28GB |
+| [MeowGPT-3.5.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q3_K_L.gguf) | Q3_K_L | 3.56GB |
+| [MeowGPT-3.5.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.IQ4_XS.gguf) | IQ4_XS | 3.67GB |
+| [MeowGPT-3.5.Q4_0.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q4_0.gguf) | Q4_0 | 3.83GB |
+| [MeowGPT-3.5.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.IQ4_NL.gguf) | IQ4_NL | 3.87GB |
+| [MeowGPT-3.5.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q4_K_S.gguf) | Q4_K_S | 3.86GB |
+| [MeowGPT-3.5.Q4_K.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q4_K.gguf) | Q4_K | 4.07GB |
+| [MeowGPT-3.5.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q4_K_M.gguf) | Q4_K_M | 4.07GB |
+| [MeowGPT-3.5.Q4_1.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q4_1.gguf) | Q4_1 | 4.24GB |
+| [MeowGPT-3.5.Q5_0.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q5_0.gguf) | Q5_0 | 4.65GB |
+| [MeowGPT-3.5.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q5_K_S.gguf) | Q5_K_S | 4.65GB |
+| [MeowGPT-3.5.Q5_K.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q5_K.gguf) | Q5_K | 4.78GB |
+| [MeowGPT-3.5.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q5_K_M.gguf) | Q5_K_M | 4.78GB |
+| [MeowGPT-3.5.Q5_1.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q5_1.gguf) | Q5_1 | 5.07GB |
+| [MeowGPT-3.5.Q6_K.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q6_K.gguf) | Q6_K | 5.53GB |
+| [MeowGPT-3.5.Q8_0.gguf](https://huggingface.co/RichardErkhov/cutycat2000x_-_MeowGPT-3.5-gguf/blob/main/MeowGPT-3.5.Q8_0.gguf) | Q8_0 | 7.17GB |
+
+
+
+
+Original model description:
+---
+license: mit
+language:
+- en
+library_name: transformers
+pipeline_tag: text-generation
+tags:
+- freeai
+- conversational
+- meowgpt
+- gpt
+- free
+- opensource
+- splittic
+- ai
+widget:
+  - text: <s> [|User|] Hello World  </s>[|Assistant|]
+---
+# MeowGPT Readme
+
+## Overview
+MeowGPT, developed by CutyCat2000x, is a language model based on Llama with the checkpoint version 3.5. This model is designed to generate text in a conversational manner and can be used for various natural language processing tasks.
+
+## Usage
+### Loading the Model
+To use MeowGPT, you can load it via the `transformers` library in Python using the following code:
+
+```python
+from transformers import LlamaTokenizer, AutoModelForCausalLM, AutoTokenizer
+
+tokenizer = LlamaTokenizer.from_pretrained("cutycat2000x/MeowGPT-3.5")
+model = AutoModelForCausalLM.from_pretrained("cutycat2000x/MeowGPT-3.5")
+```
+
+### Example Prompt
+An example of how to prompt the model for generating text:
+
+```python
+{{ bos_token }}{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% else %}{% set loop_messages = messages %}{% set system_message = false %}{% endif %}{% for message in loop_messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if loop.index0 == 0 and system_message != false %}{% set content = '<<SYS>>\\n' + system_message + '\\n<</SYS>>\\n\\n' + message['content'] %}{% else %}{% set content = message['content'] %}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + content.strip() + ' [/INST]' }}{% elif message['role'] == 'assistant' %}{{ ' '  + content.strip() + eos_token }}{% endif %}{% endfor %}
+```
+
+The &lt;s&gt; and &lt;/s&gt; are start and end tokens.
+
+## About the Model
+- **Base Model**: Llama + Mixtral
+- **Checkpoint Version**: 3.5
+- **Datasets Used**: Private
+
+## Citation
+If you use MeowGPT in your research or projects, please consider citing CutyCat2000x.
+
+## Disclaimer
+Please note that while MeowGPT is trained to assist in generating text based on given prompts, it may not always provide accurate or contextually appropriate responses. It's recommended to review and validate the generated content before usage in critical applications.
+
+For more information or support, refer to the `transformers` library documentation or CutyCat2000x's resources.
+