joaoalvarenga
/

bloom-8bit

Text Generation

text-generation-inference

Model card Files Files and versions Community

joaoalvarenga commited on Jul 11, 2022

Commit

fb4c1b6

•

1 Parent(s): cf7c1ed

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -57,7 +57,7 @@ Heavily inspired by [Hivemind's GPT-J-6B with 8-bit weights](https://huggingface
 Here, we also apply [LoRA (Low Rank Adapters)](https://arxiv.org/abs/2106.09685) to reduce model size. The original version takes \~353GB memory, this version takes **\~180GB**.
-Our main objective is to generate a model compressed enough to be deployed in a traditional Kubernetes cluster.
 ### How to use
 This model can be used by adapting Bloom original implementation. This is an adaptation from [Hivemind's GPT-J 8-bit](https://nbviewer.org/urls/huggingface.co/hivemind/gpt-j-6B-8bit/raw/main/convert-gpt-j.ipynb):

 Here, we also apply [LoRA (Low Rank Adapters)](https://arxiv.org/abs/2106.09685) to reduce model size. The original version takes \~353GB memory, this version takes **\~180GB**.
+Our main goal is to generate a model compressed enough to be deployed in a traditional Kubernetes cluster.
 ### How to use
 This model can be used by adapting Bloom original implementation. This is an adaptation from [Hivemind's GPT-J 8-bit](https://nbviewer.org/urls/huggingface.co/hivemind/gpt-j-6B-8bit/raw/main/convert-gpt-j.ipynb):