Yunus Manti

Yuma42

AI & ML interests

I'm generating and running AI to experiment and educate myself.

Recent Activity

Organizations

None yet

Yuma42's activity

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

Proposal for new column

3
#1032 opened 3 months ago by
Yuma42
replied to bartowski's post 3 months ago
view reply

Now that the software I'm using updated the llamacpp version, I'm changingbgguf. I don't get what's meant with IQ4_NL does this include IQ4_XS? So IQ4_XS is also supposed to run performant on arm or just Q4_0?

On a side note, since I had good performance with Q4ks in the past I would wish that that would also benefit from these change.