yaystevek commited on
Commit
16ebc66
1 Parent(s): 7078789

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ datasets:
5
+ - teknium/OpenHermes-2.5
6
+ license: other
7
+ license_name: llama3
8
+ base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
9
+ tags:
10
+ - unsloth
11
+ - facebook
12
+ - meta
13
+ - pytorch
14
+ - llama
15
+ - llama-3
16
+ - GGUF
17
+ ---
18
+
19
+ # QLoRA Finetune Llama 3 Instruct 8B + OpenHermes 2.5
20
+
21
+ This model is based on Llama-3-8b, and is governed by [META LLAMA 3 COMMUNITY LICENSE AGREEMENT](LICENSE)
22
+
23
+ Llama 3 Instruct 8B 4-bit from unsloth, finetuned with the OpenHermes 2.5 dataset on my home PC on one 24GB 4090.
24
+
25
+ Special care was taken to preserve and reinforce proper eos token structure.
26
+
27
+ [Source Model](https://huggingface.co/yaystevek/llama-3-8b-Instruct-OpenHermes-2.5-QLoRA)