shenzhi-wang
/

Llama3-70B-Chinese-Chat

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (2)

[AUTOMATED] Model Memory Requirements

#12 opened 6 months ago by

model-sizer-bot

ValueError: Trying to set a tensor of shape torch.Size([1024, 8192]) in "weight" (which has shape torch.Size([8192, 8192])), this look incorrect.

#11 opened 6 months ago by

请问加载这个模型要多少GPU？我24000+的提示out of memory

#10 opened 6 months ago by

Request: DOI

#9 opened 7 months ago by

没有在线体验的demo吗?

#8 opened 7 months ago by

请问能否提供EXL2量化版本?

#7 opened 7 months ago by

能不能提供awq或gptq量化模型

#6 opened 7 months ago by

请问能提供GPTQ-Int8版本吗？

#5 opened 8 months ago by

Can you provide the Q5_k_s.gguf model? Thank you.

#4 opened 8 months ago by

perfect!!!

#3 opened 8 months ago by