Raj Mehta's picture

67

Raj Mehta

rjmehta

·

AI & ML interests

None yet

Organizations

None yet

rjmehta's activity

New activity in upstage/solar-pro-preview-instruct 3 months ago

i tested the q8 in lm studio( getting wrong output)

#9 opened 3 months ago by

There really seems to be some problem with the tokenizer or the ggufs

#12 opened 3 months ago by

New activity in iiiorg/piiranha-v1-detect-personal-information 3 months ago

License

#1 opened 3 months ago by

New activity in thesven/Meta-Llama-3.1-8B-Instruct-GPTQ 5 months ago

Thanks for this 4bit. Can you create gptq 8 bits quants?

#1 opened 5 months ago by

New activity in shuyuej/Mistral-Nemo-Instruct-2407-GPTQ 5 months ago

Can you create gptq 8 bits quants?

#1 opened 5 months ago by

New activity in internlm/internlm2_5-7b-chat-1m 5 months ago

Suggestion

#3 opened 6 months ago by

New activity in google/gemma-2-27b-it 6 months ago

Exl Quants Please

#15 opened 6 months ago by

New activity in deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct 6 months ago

Exl Quants please

#5 opened 6 months ago by

New activity in mlfoundations/tabula-8b 6 months ago

How to run inference?

#1 opened 6 months ago by

New activity in LoneStriker/Phi-3-medium-4k-instruct-8.0bpw-h8-exl2 7 months ago

Phi-3 medium generation issue

#1 opened 7 months ago by

New activity in NTQAI/Nxcode-CQ-7B-orpo 7 months ago

exl quants please

#3 opened 7 months ago by

New activity in abacusai/Smaug-Llama-3-70B-Instruct 7 months ago

Exl Quants pls

#5 opened 7 months ago by

New activity in turboderp/Cat-Llama-3-70B-instruct 7 months ago

It prints only new lines.

#7 opened 7 months ago by

New activity in turboderp/Cat-Llama-3-70B-instruct 8 months ago

Exl quants pls

#6 opened 8 months ago by

New activity in cognitivecomputations/dolphin-2.9-llama3-70b 8 months ago

Instruct version please

#5 opened 8 months ago by

New activity in MaziyarPanahi/calme-2.4-llama3-70b 8 months ago

Exl2 quants please

#8 opened 8 months ago by

New activity in davidkim205/Rhea-72b-v0.5 8 months ago

Prompt format

#6 opened 8 months ago by

New activity in gradientai/Llama-3-8B-Instruct-Gradient-1048k 8 months ago

Exl quants please

#7 opened 8 months ago by

New activity in internlm/internlm-xcomposer2-4khd-7b 8 months ago

Multi image query

#8 opened 8 months ago by

Multi GPU Inference

#7 opened 8 months ago by