Update README.md

README.md

@@ -5,7 +5,7 @@ datasets:
 
 Mostly untested!
 
-# RoPE Scaled QLoRA Fine-tune of Llama-13b on airoboros-gpt4-1.4.1 (GPTQ)
+# RoPE Scaled QLoRA Fine-tune of Llama-33b on airoboros-gpt4-1.4.1 (GPTQ)
 
 ## Overview
 
@@ -61,15 +61,14 @@ Quantized with AutoGPTQ (bits = 4, group_size = 128, desc_act = True).
 
 See original model card below.
 
+# Original model card: Jon Durbin's Airoboros 33B GPT4 1.4 
 
 
-# Original model card: Jon Durbin's Airoboros 7B GPT4 1.4 
-
-__mostly untested, use if you want, or wait for some validation__
+__not yet tested!__
 
 ## Overview
 
-This is a __full__ (not qlora) fine-tune 7b parameter LlaMa model, using completely synthetic training data created gpt4 via https://github.com/jondurbin/airoboros
+This is a qlora fine-tune 33b parameter LlaMa model, using completely synthetic training data created gpt4 via https://github.com/jondurbin/airoboros
 
 This is mostly an extension of the previous gpt-4 series, with a few extras:
 
@@ -80,7 +79,7 @@ This is mostly an extension of the previous gpt-4 series, with a few extras:
 * riddles
 * all coding instructions have an equivalent " PLAINFORMAT" version now (and all rosettacode examples were trained with PLAINFORMAT)
 
-This model was fine-tuned with a fork of [FastChat](https://github.com/jondurbin/FastChat)
+This model was fine-tuned with a fork of [qlora](https://github.com/jondurbin/qlora)
 
 The prompt it was trained with was:
 
@@ -103,7 +102,7 @@ Be sure you are pulling the latest branch!
 Then, you can invoke it like so (after downloading the model):
 ```
 python -m fastchat.serve.cli \
-  --model-path airoboros-7b-gpt4-1.4 \
+  --model-path airoboros-33b-gpt4-1.4 \
   --temperature 0.5 \
   --max-new-tokens 2048 \
   --no-history
@@ -203,10 +202,11 @@ Or:
 Write a multi-threaded TCP server in C that accepts a "GET [key]" input and "SET [key] [value]" input, and uses a binary tree to get and store the input values.
 ```
 
-You can optionally add a single space and "PLAINFORMAT" at the end of your prompt to avoid backticks, explanations, etc. and just print the code, e.g.:
+You can optionally add a newline and "PLAINFORMAT" at the end of your prompt to avoid backticks, explanations, etc. and just print the code, e.g.:
 
 ```
-Write a websocket application in node.js. PLAINFORMAT
+Write a websocket application in node.js.
+PLAINFORMAT
 ```
 
 ### Word games / trivia