crumb commited on
Commit
01dd181
1 Parent(s): f0b406f

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - crumb/textbook-codex
5
+ language:
6
+ - en
7
+ tags:
8
+ - cramp
9
+ - cramped
10
+ ---
11
+
12
+ distilled zephyr-7b over 44m-textbooks on textbook codex, 1 epoch, 0.3 dropout
13
+
14
+ | avg | arc | hellaswag | mmlu | truthfulqa |
15
+ | --- | --- | --- | --- | --- |
16
+ | 30.16 | 22.4 | 25.54 | 23.11 | 49.59 |