OpenSourceRonin's picture

26 4 7

OpenSourceRonin PRO

OpenSourceRonin

·

AI & ML interests

None yet

Recent Activity

new activity about 1 month ago

deepseek-ai/DeepSeek-V3-0324:Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

updated a model about 1 month ago

VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-256-woft

updated a model about 1 month ago

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft

View all activity

Organizations

OpenSourceRonin's activity

New activity in deepseek-ai/DeepSeek-V3-0324 about 1 month ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

#19 opened about 1 month ago by

New activity in VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft about 1 month ago

Use aphrodite-engine to infer this model error

#2 opened about 1 month ago by

New activity in VPTQ-community/deepseek-r1_v_8_k_65536_256_mp4 about 1 month ago

Create README.md

#1 opened about 1 month ago by

New activity in VPTQ-community/deepseek-r1_v_8_k_65536_256 about 1 month ago

Create README.md

#1 opened about 1 month ago by

New activity in VPTQ-community/deepseek-r1_v8_k_65536_mp4 about 1 month ago

Create README.md

#1 opened about 1 month ago by

New activity in VPTQ-community/deepseek-r1_v_8_k_65536_mixed_mp4 about 1 month ago

Create README.md

#1 opened about 1 month ago by

New activity in VPTQ-community/deepseek-r1_v_8_k_65536 about 1 month ago

Create README.md

#1 opened about 1 month ago by

New activity in VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-32768-woft about 2 months ago

not run

#1 opened 6 months ago by

New activity in opensourcerelease/DeepSeek-V3-bf16 3 months ago

Please do R1

#7 opened 3 months ago by

New activity in OpenSourceRonin/VPTQ_demo 4 months ago

ghg

#1 opened 5 months ago by

New activity in opensourcerelease/DeepSeek-V3-bf16 4 months ago

Remove quantization from config.json

#4 opened 4 months ago by

AdjectiveAllison

Tokenizer config?

#2 opened 4 months ago by

some configs is miss

#1 opened 4 months ago by

New activity in deepseek-ai/DeepSeek-V3 4 months ago

Bug in fp8_cast_bf16.py

#4 opened 4 months ago by

New activity in opensourcerelease/DeepSeek-V3-Base-bf16 4 months ago

Files?

#1 opened 4 months ago by

New activity in VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft 6 months ago

not run

#1 opened 6 months ago by

New activity in VPTQ-community/Mistral-Large-Instruct-2407-v16-k65536-65536-woft 6 months ago

How do you use / load these models?

#1 opened 6 months ago by

New activity in VPTQ-community/README 7 months ago

Can you start a Space with Qwen2.5 14b?

#2 opened 7 months ago by

New activity in VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-256-woft 7 months ago

V8 vs V16?

#1 opened 7 months ago by

New activity in VPTQ-community/README 7 months ago

Will this method of quantization appear in Ollama?

#1 opened 7 months ago by