jack seaver's picture

7

jack seaver

tutu329

AI & ML interests

None yet

Organizations

None yet

tutu329's activity

New activity in Shakker-Labs/AWPortrait-FL 4 months ago

why comfyui report: ERROR: Could not detect model type of: D:\ComfyUI\models\checkpoints\AWPortrait-FL-fp8.safetensors

#7 opened 4 months ago by

New activity in bosonai/Higgs-Llama-3-70B 6 months ago

it is a 70B model. why using almost 280GB disk？

#7 opened 6 months ago by

New activity in jarrelscy/Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit 8 months ago

KeyError: 'model.layers.45.block_sparse_moe.gate.g_idx'

#2 opened 8 months ago by

New activity in Dogge/llama-3-70B-instruct-uncensored 8 months ago

will there be a gptq int4 version?

#1 opened 8 months ago by

New activity in jarrelscy/Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit 8 months ago

no special_tokens_map.json tokenizer_config.json and tokenizer.json

#1 opened 8 months ago by

New activity in MaziyarPanahi/miqu-1-70b-sf-GPTQ 11 months ago

vllm can not inter this model (other 70b gptq model are ok)

#1 opened 11 months ago by

New activity in TheBloke/Qwen-14B-Chat-AWQ about 1 year ago

hope there is a qwen-72b-chat-awq（can be inferenced by vllm）

#3 opened about 1 year ago by