add gist
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ inference: False
|
|
7 |
This is a version of `hivemind/gpt-j-6B-8bit` for low-RAM loading, i.e., free Colab runtimes :)
|
8 |
|
9 |
- shards are > 1000MB each
|
10 |
-
- a demo notebook of how to use it is
|
11 |
**Please refer to the [original model card](https://huggingface.co/hivemind/gpt-j-6B-8bit) for all details.**
|
12 |
|
13 |
## Usage
|
|
|
7 |
This is a version of `hivemind/gpt-j-6B-8bit` for low-RAM loading, i.e., free Colab runtimes :)
|
8 |
|
9 |
- shards are > 1000MB each
|
10 |
+
- a demo notebook of how to use it [is here](https://colab.research.google.com/gist/pszemraj/1c0b32173df5b1efbdb7a2358ed4195b/generate-text-with-an-llm-sharded-on-huggingface.ipynb)
|
11 |
**Please refer to the [original model card](https://huggingface.co/hivemind/gpt-j-6B-8bit) for all details.**
|
12 |
|
13 |
## Usage
|