iwaitu
/

llama-3.1-70b-chinese-chat-AWQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Quantization Script

#4 opened about 2 months ago by

请教awq

#3 opened about 2 months ago by

输出不稳定

#2 opened 5 months ago by

Is there a 2-bit quantized version

#1 opened 5 months ago by