Alibaba-NLP
/

gte-Qwen2-7B-instruct

请问支持fp16推理吗？

#23

by DJCan - opened Jul 31

如题

Alibaba-NLP org Aug 1

支持的

请问如何进行fp16推理，是直接修改config.json中的torch_dtype么

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment