unsloth
/

Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Problem loading with vllm

#8 opened about 2 months ago by

vram+ram

#7 opened 2 months ago by

Code

#6 opened 2 months ago by

code

#5 opened 2 months ago by

colab t4

#4 opened 2 months ago by

convert

#3 opened 2 months ago by

to gguf

#2 opened 2 months ago by

how to run

#1 opened 2 months ago by