inarikami commited on
Commit
325d462
1 Parent(s): 388afd1

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Falcon-40B-Instruct 8-bit Model
2
+
3
+ This repository is home to the Falcon-40B-Instruct model, which has been carefully converted from its original 32-bit mode to an efficient and compact 8-bit file.
4
+
5
+ # Usage
6
+
7
+ You can use this model directly with a pipeline for tasks such as text generation and instruction following:
8
+
9
+ ```python
10
+ from transformers import pipeline
11
+
12
+ generator = pipeline('text-generation', model='tensorcat/falcon-40b-instruct-8bit')
13
+ print(generator("Generate a story about a spaceship traveling through space.", max_length=200))
14
+
15
+ ```
16
+