not run
#1
by
sdyy
- opened
It never works in Colab T4
If you have a code that works in Colab T4
Please provide it to us
Hi @sdyy
A T4 GPU has only 16 GB of VRAM, which does not fit this 40 GB model. I would suggest trying our other models such as xmadai/Mistral-Small-Instruct-2409-xMADai-INT4 and xmadai/gemma-2-9b-it-xMADai-INT4, which fits within 16 GB.
Let us know if you have further questions.