Upload folder using huggingface_hub (#1)

- 8d301bdab054a6f15799ecc1bb78d7e950a6c4a0c101e78542f931aabf102b33 (fc5f24c002abff179d85fdb6ca4f38bc4bbf53bd)
- 2f9001b31602a964ea8f3a6d41b604706603305ac64b67faec85db9a74e4933c (4e5883705a527285165d5a18847e658016428009)
- 3e0d5d7aff74a1267583423110f577873188cc03b59fa60184bff37d1d566072 (aa3a5ec135d1e2c45e325804f5a8e6d3a44658b4)
- fd50d3041783d3b496a819b182c55608852cefdd0e28fcf4f2f0b81ae0e6684d (33852191518f19e793fe7de5b7ca308c970eae56)
- a5560c96ae336a19db7ed0920d6d1a115bf5e7584e486c8cc190f6406b30b314 (8c4c5e5ae88b4ece2ee91aa3501c04dea9623a90)
- 6413a3349861aadd7622db34dfcc1292490632b6da5d1b7087af1cefa6d81f0e (7c3c4bc0fcef234d2d5132f784d49c70b15e05f3)

.gitattributes

@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+magnum-twilight-12b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+magnum-twilight-12b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+magnum-twilight-12b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+magnum-twilight-12b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+magnum-twilight-12b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
+magnum-twilight-12b-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,45 @@
+---
+base_model: grimjim/magnum-twilight-12b
+inference: false
+model_creator: grimjim
+model_name: magnum-twilight-12b-GGUF
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- text-generation
+---
+# [MaziyarPanahi/magnum-twilight-12b-GGUF](https://huggingface.co/MaziyarPanahi/magnum-twilight-12b-GGUF)
+- Model creator: [grimjim](https://huggingface.co/grimjim)
+- Original model: [grimjim/magnum-twilight-12b](https://huggingface.co/grimjim/magnum-twilight-12b)
+
+## Description
+[MaziyarPanahi/magnum-twilight-12b-GGUF](https://huggingface.co/MaziyarPanahi/magnum-twilight-12b-GGUF) contains GGUF format model files for [grimjim/magnum-twilight-12b](https://huggingface.co/grimjim/magnum-twilight-12b).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

magnum-twilight-12b-GGUF_imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c028a1092fcf74cd414d72d2e1cf808dc24a0b6ea710110dff1965d22729714d
+size 7054394

magnum-twilight-12b.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9990bb2086d4d8cd0dc7279a802bf455e6fdc30459dc547345849272b6a393d
+size 8727635168

magnum-twilight-12b.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e741dfe5c26eb11f91f9ff51e564a1cdffbb32cba5a0bf141cb5c6bd5baebb57
+size 8518739168

magnum-twilight-12b.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:144a60835bc929c01a239bc38ac3f62eb0995c3d566ee34e5307010be5a5d5dd
+size 10056213728

magnum-twilight-12b.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ff81066b8254431a305a6de3c5fe97d2f645d33693371e3b796b07683e928afd
+size 13022373088

magnum-twilight-12b.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7a0a0f7392576413b161765eca84527af99d3b85f384ef6d881c897c7ac8a4b
+size 24504280064