Update README.md
Browse files
README.md
CHANGED
@@ -26,4 +26,12 @@ inputs = inputs.to("cuda")
|
|
26 |
generate_ids = model.generate(**inputs)
|
27 |
output = tokenizer.batch_decode(generate_ids)[0]
|
28 |
print(output)
|
29 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
26 |
generate_ids = model.generate(**inputs)
|
27 |
output = tokenizer.batch_decode(generate_ids)[0]
|
28 |
print(output)
|
29 |
+
```
|
30 |
+
|
31 |
+
You could also alternatively launch a CLI demo by using the script in https://github.com/hiyouga/LLaMA-Efficient-Tuning
|
32 |
+
```bash
|
33 |
+
python src/cli_demo.py \
|
34 |
+
--model_name_or_path baichuan-inc/baichuan-7B \
|
35 |
+
--checkpoint_dir hiyouga/baichuan-7b-sft \
|
36 |
+
--prompt_template ziya
|
37 |
+
```
|