Create README.md

README.md

@@ -0,0 +1,8 @@
+# Better Language Models and Their Implications (GPT2)
+<b>Paper:</b> <a href="https://openai.com/blog/better-language-models/">https://openai.com/blog/better-language-models/</a>  
+ 
+# About
+These are the pretrained weights for [this](https://github.com/matthias-wright/flaxmodels/tree/main/flaxmodels/gpt2) ResNet implementation in Jax/Flax. The weights are taken from [this](https://github.com/huggingface/transformers/tree/master/src/transformers/models/gpt2) repository. 
+
+# Documentation
+[Here](https://github.com/matthias-wright/flaxmodels/blob/main/docs/Documentation.md#1-checkpoints) is a documentation that explains the preprocessing steps as well as the format of the pretrained weights.