OuteAI
/

Lite-Oute-2-Mamba2Attn-250M-Base

Model card Files Files and versions Community

edwko commited on Aug 24

Commit

38bb2fc

•

1 Parent(s): fecf524

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -152,7 +152,8 @@ model = AutoModelForCausalLM.from_pretrained(
     trust_remote_code=True,
     # If you have installed flash attention 2
-    # attn_implementation="flash_attention_2",
 )
 model.to(device)
 tokenizer = AutoTokenizer.from_pretrained("OuteAI/Lite-Oute-2-Mamba2Attn-Base")

     trust_remote_code=True,
     # If you have installed flash attention 2
+    # attn_implementation="flash_attention_2",
+    # torch_dtype=torch.bfloat16,
 )
 model.to(device)
 tokenizer = AutoTokenizer.from_pretrained("OuteAI/Lite-Oute-2-Mamba2Attn-Base")