Commit
•
745c23d
1
Parent(s):
b03577b
Update README.md
Browse files
README.md
CHANGED
|
@@ -43,6 +43,7 @@ To use the model with quantization:
|
|
| 43 |
|
| 44 |
```python
|
| 45 |
from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
|
|
|
|
| 46 |
|
| 47 |
bnb_config = BitsAndBytesConfig(
|
| 48 |
load_in_4bit=True,
|
|
|
|
| 43 |
|
| 44 |
```python
|
| 45 |
from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
|
| 46 |
+
import torch
|
| 47 |
|
| 48 |
bnb_config = BitsAndBytesConfig(
|
| 49 |
load_in_4bit=True,
|