gustavecortal
commited on
Commit
•
7fbdfb5
1
Parent(s):
c7e1806
Update README.md
Browse files
README.md
CHANGED
@@ -16,6 +16,12 @@ This is a version of Cedille's GPT-J (fr-boris) with 6 billion parameters that i
|
|
16 |
|
17 |
Here's how to run it: [![colab](https://camo.githubusercontent.com/84f0493939e0c4de4e6dbe113251b4bfb5353e57134ffd9fcab6b8714514d4d1/68747470733a2f2f636f6c61622e72657365617263682e676f6f676c652e636f6d2f6173736574732f636f6c61622d62616467652e737667)](https://colab.research.google.com/drive/1ft6wQU0BhqG5PRlwgaZJv2VukKKjU4Es)
|
18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
## fr-boris
|
20 |
|
21 |
Boris is a 6B parameter autoregressive language model based on the GPT-J architecture and trained using the [mesh-transformer-jax](https://github.com/kingoflolz/mesh-transformer-jax) codebase.
|
@@ -26,4 +32,4 @@ Boris was trained on around 78B tokens of French text from the [C4](https://hugg
|
|
26 |
|
27 |
* [Cedille](https://en.cedille.ai/)
|
28 |
* [Hivemind](https://training-transformers-together.github.io/)
|
29 |
-
* [
|
|
|
16 |
|
17 |
Here's how to run it: [![colab](https://camo.githubusercontent.com/84f0493939e0c4de4e6dbe113251b4bfb5353e57134ffd9fcab6b8714514d4d1/68747470733a2f2f636f6c61622e72657365617263682e676f6f676c652e636f6d2f6173736574732f636f6c61622d62616467652e737667)](https://colab.research.google.com/drive/1ft6wQU0BhqG5PRlwgaZJv2VukKKjU4Es)
|
18 |
|
19 |
+
This model can be easily loaded using the `GPTJForCausalLM` functionality:
|
20 |
+
```python
|
21 |
+
from transformers import GPTJForCausalLM
|
22 |
+
model = GPTJForCausalLM.from_pretrained("gustavecortal/fr-boris-8bit")
|
23 |
+
```
|
24 |
+
|
25 |
## fr-boris
|
26 |
|
27 |
Boris is a 6B parameter autoregressive language model based on the GPT-J architecture and trained using the [mesh-transformer-jax](https://github.com/kingoflolz/mesh-transformer-jax) codebase.
|
|
|
32 |
|
33 |
* [Cedille](https://en.cedille.ai/)
|
34 |
* [Hivemind](https://training-transformers-together.github.io/)
|
35 |
+
* [Gustave Cortal](https://twitter.com/gustavecortal)
|