model size

#5
by hmd-amn - opened

The llama 13b size is 26Gb, so I can assume that Alpaca-13b has the same size, but here it is more than 40Gb and can't be loaded on A100 40 Gb .

The llama 13b size is 26Gb, so I can assume that Alpaca-13b has the same size, but here it is more than 40Gb and can't be loaded on A100 40 Gb .

It's saved as float32. 26gb should be float16....

Sign up or log in to comment