dt ooo's picture

dt ooo

sdyy

·

AI & ML interests

None yet

Recent Activity

new activity 9 days ago

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4:it run locally 16gb vram

new activity about 1 month ago

ISTA-DASLab/Phi-3-medium-4k-instruct-AQLM-PV-1Bit-1x16-hf:run but

updated a model about 1 month ago

sdyy/bb

View all activity

Organizations

None yet

sdyy's activity

New activity in Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4 9 days ago

it run locally 16gb vram

#1 opened 9 days ago by

New activity in ISTA-DASLab/Phi-3-medium-4k-instruct-AQLM-PV-1Bit-1x16-hf about 1 month ago

run but

#1 opened about 1 month ago by

updated a model about 1 month ago

sdyy/bb

Updated Dec 20, 2024 • 3

New activity in ISTA-DASLab/Qwen2-72B-AQLM-PV-1bit-1x16 about 1 month ago

run in colab t4

#1 opened about 1 month ago by

New activity in ISTA-DASLab/Meta-Llama-3-70B-AQLM-PV-1Bit-1x16 about 1 month ago

it run but

#1 opened 2 months ago by

New activity in OPEA/Qwen2.5-3B-Instruct-int4-sym-inc about 1 month ago

STOP

#1 opened about 1 month ago by

New activity in argmaxinc/mlx-FLUX.1-schnell-4bit-quantized about 1 month ago

not run

#6 opened about 2 months ago by

New activity in ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf about 1 month ago

You are using a model of type mixtral_aqlm to instantiate a model of type mixtral. This is not supported for all configurations of models and can yield errors.

#3 opened 12 months ago by

New activity in ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16 about 1 month ago

bad

#4 opened about 1 month ago by

New activity in mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq about 1 month ago

not run

#6 opened about 1 month ago by

New activity in mobiuslabsgmbh/Llama-2-7b-chat-hf-4bit_g64-HQQ about 1 month ago

not run

#1 opened about 1 month ago by

New activity in mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq about 1 month ago

Error with adapter ?

#2 opened 10 months ago by

Make it usageable for cpu

#3 opened 9 months ago by

New activity in relaxml/Llama-2-7b-QTIP-2Bit about 1 month ago

colab t4

#3 opened about 1 month ago by

New activity in ModelCloud/gemma-2-9b-it-gptq-4bit about 1 month ago

colab t4

#3 opened about 1 month ago by

New activity in Satwik11/QwQ-32B-Preview-quantized-autoround-GPTQ-sym-4bit about 2 months ago

colab

#1 opened about 2 months ago by

New activity in state-spaces/mamba-130m about 2 months ago

model_type

#4 opened about 2 months ago by

New activity in bartowski/falcon-mamba-7b-GGUF about 2 months ago

model_type

#1 opened about 2 months ago by

New activity in devingulliver/mamba-gguf about 2 months ago

error loading model: unknown model architecture: 'mamba'

#1 opened 2 months ago by

New activity in black-forest-labs/FLUX.1-dev about 2 months ago

Python Script to run it below 16GB vram

#50 opened 6 months ago by