Upload folder using huggingface_hub (#1)

- 86e7720f6397e324382f16a90cc16ac6d84383c7f0b45f9440886d7062bbbaf8 (e2887c8f69b9944b8af898edc565d4e45f16e701)
- 62a0b020c2f3d913e1aa43cd250576ede786cdea9ed4984082394f2b8d9007a8 (35493145afae8b93c71710ab5a89e3f5f34a37ea)
- 323995d4c8db8caed4d68d51875ef3eab224428d4c2f6729fce29c9c0cc43a5f (ff6350a80f9d4a2cab9f3e9306db67a4a4817010)
- 1e36917913684744f937b9f2fc63fe0b55e6f01f0f2f52734b7f5ede62348b1b (abb4f3326628958ba33f333a7cc9b198392bf256)
- b36e0f855f3bada1f0c6ad287c48a5dc94a746336737fb17ac352cadb7742096 (a0dc4ace74468a67a965a6b987f85e40e72f523d)
- 2f97fe1048182d2ad0a6fd8a65d9f189b7ef68932d37b7374d361daffc2af7c4 (b4f89e2a921734fd7dbe98cffd95f2674670f121)
- 399fdccf1082c3fabb972626563c6e32564b525bacad7982dff67eacc47c8db7 (52ac11636d2f8906eae5645fff8a6d25d30f4b23)
- c549788b15bcd39a4de75e2a02838d514ee7de05e75c7a2921567386add1e9d5 (05f4f53fd624b7f2f1ce0945a69b02386c9dd866)
- e518a90eea5c8c9293a25ee06bf855e56bb9a88810160b9c4d645aaa100c1532 (b5fed75e2c376b568572901673eeb1497e4d14e3)
- 1a57866267d5b10353b2b39c7b19b5ad627a217251e43525134fb185ffba10ba (a43e95a02197c71f0a3c2e4c87b8d3957e519069)
- f4e1839e75faa94a80edfbcc9598d6f9cbf42700dd652883f92cc58c1bb094ba (0199cdee26b803bc89b6d99e5c47d67bb560729a)
- 32a3e04999288cd3d4eb282a71f4fb9a7ec9a98aac5491d9beb95b74865cfb09 (77a6432f76bc407b7449581ab2ad967ddfeeac62)

.gitattributes

@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+Experiment27pasticheT3q-7B.fp16.gguf filter=lfs diff=lfs merge=lfs -text

Experiment27pasticheT3q-7B.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f5c5675b9e110fe4a8cfd1c956578aa35a76fe30231d501f12b7545653f62a5b
+size 2719242080

Experiment27pasticheT3q-7B.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b130afe4d869b20ffbecfa992007f42572503f1bf22b8ba05e0fd3811601bc50
+size 3822024544

Experiment27pasticheT3q-7B.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c92a0448a8f9ce448662ae460833622a5bb15f11cc862690613a945d5b6e6898
+size 3518986080

Experiment27pasticheT3q-7B.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:83862f5b63c0baaf0b10d8379365db3dc2838df23e4e32bb65b497f04b792b93
+size 3164567392

Experiment27pasticheT3q-7B.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1fe6cb068d16764c85dfd48f3c2827416e71541561bba9ff8e6b34a352e2a65d
+size 4368439136

Experiment27pasticheT3q-7B.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:61d3b445e3502d9c332ca7c59e75080758b2120b62bb3591b2df3750938e8d27
+size 4140373856

Experiment27pasticheT3q-7B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:282f8417ffd4c2bc65cee98c405ef033f2d7f4fb074ca3a8efb7324be2bd73a5
+size 5131409248

Experiment27pasticheT3q-7B.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7399f44400d167713241e36506f89b3cf2166f4717bc28e113eaf5dabc27add2
+size 4997715808

Experiment27pasticheT3q-7B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a1a880dee3f32d658eebc5b5ff0942d0cbfb009adeec66421ff84f4efdb3aa60
+size 5942064992

Experiment27pasticheT3q-7B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:deb4f364222b05a995c87193ac1f42a57277bf517074f1a1ccff53e9af9214e5
+size 7695857504

Experiment27pasticheT3q-7B.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:65b3b5cabba1e9337f977ba4c2225852373349076b3b95aefcd7c92a9e83b10f
+size 14484731744

README.md

@@ -0,0 +1,60 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- transformers
+- safetensors
+- mistral
+- text-generation
+- merge
+- mergekit
+- lazymergekit
+- automerger
+- base_model:automerger/Experiment27Pastiche-7B
+- base_model:chihoonlee10/T3Q-Mistral-Orca-Math-DPO
+- license:apache-2.0
+- autotrain_compatible
+- endpoints_compatible
+- text-generation-inference
+- region:us
+- text-generation
+model_name: Experiment27pasticheT3q-7B-GGUF
+base_model: automerger/Experiment27pasticheT3q-7B
+inference: false
+model_creator: automerger
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/Experiment27pasticheT3q-7B-GGUF](https://huggingface.co/MaziyarPanahi/Experiment27pasticheT3q-7B-GGUF)
+- Model creator: [automerger](https://huggingface.co/automerger)
+- Original model: [automerger/Experiment27pasticheT3q-7B](https://huggingface.co/automerger/Experiment27pasticheT3q-7B)
+
+## Description
+[MaziyarPanahi/Experiment27pasticheT3q-7B-GGUF](https://huggingface.co/MaziyarPanahi/Experiment27pasticheT3q-7B-GGUF) contains GGUF format model files for [automerger/Experiment27pasticheT3q-7B](https://huggingface.co/automerger/Experiment27pasticheT3q-7B).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.