Upload folder using huggingface_hub

.gitattributes

@@ -1,35 +1,7 @@
-*.7z filter=lfs diff=lfs merge=lfs -text
-*.arrow filter=lfs diff=lfs merge=lfs -text
-*.bin filter=lfs diff=lfs merge=lfs -text
-*.bz2 filter=lfs diff=lfs merge=lfs -text
-*.ckpt filter=lfs diff=lfs merge=lfs -text
-*.ftz filter=lfs diff=lfs merge=lfs -text
-*.gz filter=lfs diff=lfs merge=lfs -text
-*.h5 filter=lfs diff=lfs merge=lfs -text
-*.joblib filter=lfs diff=lfs merge=lfs -text
-*.lfs.* filter=lfs diff=lfs merge=lfs -text
-*.mlmodel filter=lfs diff=lfs merge=lfs -text
-*.model filter=lfs diff=lfs merge=lfs -text
-*.msgpack filter=lfs diff=lfs merge=lfs -text
-*.npy filter=lfs diff=lfs merge=lfs -text
-*.npz filter=lfs diff=lfs merge=lfs -text
-*.onnx filter=lfs diff=lfs merge=lfs -text
-*.ot filter=lfs diff=lfs merge=lfs -text
-*.parquet filter=lfs diff=lfs merge=lfs -text
-*.pb filter=lfs diff=lfs merge=lfs -text
-*.pickle filter=lfs diff=lfs merge=lfs -text
-*.pkl filter=lfs diff=lfs merge=lfs -text
-*.pt filter=lfs diff=lfs merge=lfs -text
-*.pth filter=lfs diff=lfs merge=lfs -text
-*.rar filter=lfs diff=lfs merge=lfs -text
-*.safetensors filter=lfs diff=lfs merge=lfs -text
-saved_model/**/* filter=lfs diff=lfs merge=lfs -text
-*.tar.* filter=lfs diff=lfs merge=lfs -text
-*.tar filter=lfs diff=lfs merge=lfs -text
-*.tflite filter=lfs diff=lfs merge=lfs -text
-*.tgz filter=lfs diff=lfs merge=lfs -text
-*.wasm filter=lfs diff=lfs merge=lfs -text
-*.xz filter=lfs diff=lfs merge=lfs -text
-*.zip filter=lfs diff=lfs merge=lfs -text
-*.zst filter=lfs diff=lfs merge=lfs -text
-*tfevents* filter=lfs diff=lfs merge=lfs -text
+MoMo-72B-lora-1.8.6-DPO-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+MoMo-72B-lora-1.8.6-DPO-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+MoMo-72B-lora-1.8.6-DPO-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MoMo-72B-lora-1.8.6-DPO-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MoMo-72B-lora-1.8.6-DPO-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MoMo-72B-lora-1.8.6-DPO-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MoMo-72B-lora-1.8.6-DPO-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text

MoMo-72B-lora-1.8.6-DPO-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bfe8dea5fe9924e4bd786c4a92f309fe3ca99acd4dfcb1c6547b7db1c4810c95
+size 27077445024

MoMo-72B-lora-1.8.6-DPO-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:970e66f6c6fb73e54ab73d4429571f96fddecfb88ae4517c362117e192cd81ec
+size 38486640032

MoMo-72B-lora-1.8.6-DPO-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d921c443f2e7251be2ca3cb024f59ab5e4bcb6a650c2391eb0c0f192388741d8
+size 35273803168

MoMo-72B-lora-1.8.6-DPO-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:780973c32eda322678f212b0c64222dd63b1eacb7809d0790ce234ccc221ac5a
+size 31566038432

MoMo-72B-lora-1.8.6-DPO-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f211bb3c6da21bb86db7e5d57c27fd81c9323612bf04edf2822ede6c08c5a29d
+size 43769136544

MoMo-72B-lora-1.8.6-DPO-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8a5dd60c12313268e4beddb1bd3966d8e6606473c7b71a758421d28b330157a4
+size 41286108576

MoMo-72B-lora-1.8.6-DPO-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0bc74c6c21bdbf5c3d79220b9c155667655d2acd9737299b738910a5ceb7486e
+size 49880761760

README.md

@@ -0,0 +1,45 @@
+---
+license: mit
+language:
+- en
+---
+# **Introduction**
+MoMo-72B-lora-1.8.6-DPO is trained via Direct Preference Optimization([DPO](https://arxiv.org/abs/2305.18290)) from [MoMo-72B-LoRA-V1.4](https://huggingface.co/moreh/MoMo-72B-LoRA-V1.4) as its base model, with several optimizations in hyperparameters.  
+[MoMo-72B-LoRA-V1.4](https://huggingface.co/moreh/MoMo-72B-LoRA-V1.4) is trained via Supervised Fine-Tuning (SFT) using [LoRA](https://arxiv.org/abs/2106.09685), with the QWEN-72B model as its base-model.  
+Note that we did not exploit any form of weight merge.  
+For leaderboard submission, the trained weight is realigned for compatibility with llama.  
+MoMo-72B is trained using **[Moreh](https://moreh.io/)**'s [MoAI platform](https://moreh.io/product), which simplifies the training of large-scale models, and AMD's MI250 GPU.
+
+
+## Details
+### Used Librarys
+- torch
+- peft
+### Used Datasets
+- [slimorca](Open-Orca/SlimOrca)
+- [truthy](https://huggingface.co/datasets/jondurbin/truthy-dpo-v0.1)
+- [orca_dpo_pairs](https://huggingface.co/datasets/Intel/orca_dpo_pairs)
+- No other dataset was used
+- No benchmark test set or the training set are used
+  - [data contamination check](https://github.com/swj0419/detect-pretrain-code-contamination) result
+    
+| Model                        | ARC   | MMLU | TruthfulQA | GSM8K |
+|------------------------------|-------|-------|-------|-------|
+| **V1.8.6(result < 0.1, %)**| TBU |TBU | 0.73 | TBU |
+### Used Environments
+- AMD MI250 & MoAI platform
+- Please visit https://moreh.io/product for more information about MoAI platform
+- Or, contact us directly [[email protected]](mailto:[email protected])
+
+## How to use
+
+```python
+# pip install transformers==4.35.2
+import torch
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+tokenizer = AutoTokenizer.from_pretrained("moreh/MoMo-72B-lora-1.8.6-DPO")
+model = AutoModelForCausalLM.from_pretrained(
+    "moreh/MoMo-72B-lora-1.8.6-DPO"
+)
+```