Text Generation
KerasHub
Keras
Divyasreepat commited on
Commit
d5f3e1c
1 Parent(s): f996710

Update README.md with new model card content

Browse files
Files changed (1) hide show
  1. README.md +49 -13
README.md CHANGED
@@ -1,16 +1,52 @@
1
  ---
2
  library_name: keras-hub
3
  ---
4
- This is a [`Bloom` model](https://keras.io/api/keras_hub/models/bloom) uploaded using the KerasHub library and can be used with JAX, TensorFlow, and PyTorch backends.
5
- Model config:
6
- * **name:** bloom_backbone
7
- * **trainable:** True
8
- * **vocabulary_size:** 250880
9
- * **num_layers:** 24
10
- * **num_heads:** 16
11
- * **hidden_dim:** 1024
12
- * **intermediate_dim:** 4096
13
- * **dropout:** 0.0
14
- * **layer_norm_epsilon:** 1e-05
15
-
16
- This model card has been generated automatically and should be completed by the model author. See [Model Cards documentation](https://huggingface.co/docs/hub/model-cards) for more information.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  library_name: keras-hub
3
  ---
4
+ ### Model Overview
5
+ BLOOM as described in as descriped in [BLOOM: A 176B-Parameter Open-Access Multilingual Language Model](https://arxiv.org/pdf/2211.05100.pdf), is a large language model published by BigScience. BLOOM is able to output coherent text in 46 languages and 13 programming languages. BLOOM models range in size from 0.5 billion to 3 billion parameters. See the model card below for benchmarks, data sources, and intended use cases.
6
+
7
+ Weights are released under the [RAIL License](https://www.licenses.ai/ai-licenses). Keras model code is released under the [Apache 2 License](https://github.com/keras-team/keras-hub/blob/master/LICENSE).
8
+
9
+ ## Links
10
+
11
+ * [BLOOM Quickstart Notebook](https://www.kaggle.com/code/smnsdt/bloom-quickstart)
12
+ * [BLOOM API Documentation](https://keras.io/api/keras_hub/models/bloom/)
13
+ * [BLOOM Model Card](https://huggingface.co/bigscience/bloom)
14
+ * [KerasHub Beginner Guide](https://keras.io/guides/keras_hub/getting_started/)
15
+ * [KerasHub Model Publishing Guide](https://keras.io/guides/keras_hub/upload/)
16
+
17
+ ## Installation
18
+
19
+ Keras and KerasHub can be installed with:
20
+
21
+ ```
22
+ pip install -U -q keras-hub
23
+ pip install -U -q keras>=3
24
+ ```
25
+
26
+ Jax, TensorFlow, and Torch come preinstalled in Kaggle Notebooks. For instructions on installing them in another environment see the [Keras Getting Started](https://keras.io/getting_started/) page.
27
+
28
+ ## Presets
29
+
30
+ The following model checkpoints are provided by the Keras team. Full code examples for each are available below.
31
+
32
+ | Preset name | Parameters | Description |
33
+ |---------------------|------------|------------------------------|
34
+ | `bloom_560m_multi` | 559M | 560M base model |
35
+ | `bloom_1.1b_multi` | 1.06B | 1B base model |
36
+ | `bloom_1.7b_multi` | 1.72B | 1.7B base model |
37
+ | `bloom_3b_multi` | 3B | 3B base model |
38
+ | `bloomz_560m_multi` | 559M | 560m instruction-tuned model |
39
+ | `bloomz_1.1b_multi` | 1.06B | 1B instruction-tuned model |
40
+ | `bloomz_1.7b_multi` | 1.72B | 1.7B instruction-tuned model |
41
+ | `bloomz_3b_multi` | 3B | 3B instruction-tuned model |
42
+
43
+ ## Prompts
44
+
45
+ The performance may vary depending on the prompt. For BLOOMZ models, we recommend making it very clear when the input stops to avoid the model trying to continue it. For example, the prompt "Translate to English: Je t'aime" without the full stop (.) at the end, may result in the model trying to continue the French sentence. Better prompts are e.g. "Translate to English: Je t'aime.", "Translate to English: Je t'aime. Translation:" "What is "Je t'aime." in English?", where it is clear for the model when it should answer. Further, we recommend providing the model as much context as possible. For example, if you want it to answer in Telugu, then tell the model, e.g. "Explain in a sentence in Telugu what is backpropagation in neural networks.".
46
+
47
+ ### Example Usage
48
+
49
+
50
+ ## Example Usage with Hugging Face URI
51
+
52
+