yuhkis commited on
Commit
91e479f
·
verified ·
1 Parent(s): c46f489

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -24
README.md CHANGED
@@ -22,30 +22,6 @@ This is a LoRA-tuned version of LLM-jp-3-13b, fine-tuned on the Ichikara Instruc
22
 
23
  ## Uses
24
 
25
- ### Direct Use
26
-
27
- To use this model for inference:
28
-
29
- ```python
30
- from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
31
- import torch
32
-
33
- model_id = "yuhkis/llm-jp-3-13b-finetune"
34
- bnb_config = BitsAndBytesConfig(
35
- load_in_4bit=True,
36
- bnb_4bit_quant_type="nf4",
37
- bnb_4bit_compute_dtype=torch.bfloat16,
38
- )
39
-
40
- model = AutoModelForCausalLM.from_pretrained(
41
- model_id,
42
- quantization_config=bnb_config,
43
- device_map="auto",
44
- token=HF_TOKEN
45
- )
46
- tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True, token=HF_TOKEN)
47
- ```
48
-
49
  ### Output Generation and Format
50
 
51
  #### Implementation Details
 
22
 
23
  ## Uses
24
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
  ### Output Generation and Format
26
 
27
  #### Implementation Details