No model file found in repo 'mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1'
I have been traing to use this model but It's been impossible to download to use it in local. Could you tell me if this model is free use or not?
What kind of error do you get ? It should work out-of-the-box even without setting a hugging face token
this is the errror: No model file found in repo 'mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1'. I am downloanding whit
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=compute_dtype, attn_implementation="sdpa", device_map=device)
tokenizer = AutoTokenizer.from_pretrained(model_id)
I just tried in a fresh instance and it worked fine, maybe try to update transformers pip install transformers --upgrade
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
compute_dtype = torch.bfloat16
device = 'cuda'
model_id = "mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1"
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=compute_dtype, attn_implementation="sdpa", device_map=device)
tokenizer = AutoTokenizer.from_pretrained(model_id)
can u share code to do benchmark of ai?
https://huggingface.co/mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1#performance
can u share code to do benchmark of ai?
https://huggingface.co/mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1#performance
You can use https://github.com/EleutherAI/lm-evaluation-harness/ for benchmarking