Update README.md

README.md

@@ -17,7 +17,16 @@ This model is based on [microsoft/phi-1_5](https://huggingface.co/microsoft/phi-
 
 ## Model description
 
-The model was trained for a context length of 1024 tokens.
+The model was trained for a context length of 1024 tokens. In addition, while the original model has a hidden size of 2048 (1.3B parameters), this model has a hidden size of 1024 (450.3M parameters).
+
+The model used for training was as follows:
+```
+model_config = AutoConfig.from_pretrained(
+    'microsoft/phi-1_5', vocab_size=len(trained_tokenizer), max_position_embeddings=1024,
+    hidden_size=1024, attn_implementation="flash_attention_2", trust_remote_code=True
+)
+model = AutoModelForCausalLM.from_config(model_config, trust_remote_code=True)
+```
 
 ## Intended uses & limitations