LimYeri
/

CodeMind-Gemma-7B-QLoRA-4bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

LimYeri commited on Apr 18

Commit

b48a439

•

1 Parent(s): a8a54c2

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -50,8 +50,8 @@ Below we share some code snippets on how to get quickly started with running the
 # pip install accelerate
 from transformers import AutoTokenizer, AutoModelForCausalLM
-tokenizer = AutoTokenizer.from_pretrained("LimYeri/CodeMind-Gemma-7B-QLoRA-4bit")
 model = AutoModelForCausalLM.from_pretrained("LimYeri/CodeMind-Gemma-7B-QLoRA-4bit")
 def get_completion(query: str, model, tokenizer) -> str:
   device = "cuda:0"

 # pip install accelerate
 from transformers import AutoTokenizer, AutoModelForCausalLM
 model = AutoModelForCausalLM.from_pretrained("LimYeri/CodeMind-Gemma-7B-QLoRA-4bit")
+tokenizer = AutoTokenizer.from_pretrained("LimYeri/CodeMind-Gemma-7B-QLoRA-4bit")
 def get_completion(query: str, model, tokenizer) -> str:
   device = "cuda:0"