avemio

/

German-RAG-PHI-3.5-MINI-4B-SFT-HESSIAN-AI

like 0

Follow

Avemio AG 7

same test on each model - one question, receive same 20 snippet (a 1024 chracters) from embedded model
16k contextsize
600pages PDF embedded

grag-nemo-12b-sft-hessian-ai - 80%
grag-llama-3.1-8b-sft-hessian-ai - 70%
grag-phi-3.5-mini-4b-sft-hessian-ai - no use

answers in comparison to
SauerkrautLM-Nemo-12b-Instruct - 90%
SauerkrautLM-Llama-3.1-8b-Instruct - 90%

but keep working, the German community is very quiet ;)