avemio

/

German-RAG-MISTRAL-7B-v3.0-SFT-HESSIAN-AI

like 0

Follow

Avemio AG 7

Hi there,

maybe this is a newbie question but i'm trying to run the avemio models in ollama.
using ollama create i get this error:

ollama create German-RAG-MISTRAL-7B-v3.0-SFT-HESSIAN-AI
gathering model components
copying file sha256:cbc6794804f721801ea6c72c3c4fd382624cdf3d9bad1b30adc20c4a392ca068 100%
copying file sha256:dcdd0cbdfbe43cf0703b7c3aa0d27bc0312d7da921e565c0ad597d3bf2f984f7 100%
copying file sha256:65cd557597285908613b4a7d07ea0beb32b106f7b1016181679debc0d50fa5f2 100%
copying file sha256:37f00374dea48658ee8f5d0f21895b9bc55cb0103939607c8185bfd1c6ca1f89 100%
copying file sha256:292316c2f63644cfd9dbca968f05d18dcfdb425f5a7452ce54eb3ab877c9a6b7 100%
copying file sha256:3b8748c0193cadf546a3eb462b4476beaba8e1893077d494c59ec5f4fa2f0b80 100%
copying file sha256:d728115c4543557ee096dde1a312a3990ea5e5460e423c0f300730199795205a 100%
copying file sha256:18855ab95b1a7cf08379a5909d9978233249fdb777aa0ed881620ad5466f5fde 100%
copying file sha256:36d1b78ef29df37f40cbb1aa8b907200797be6a54cac091e5cb646b819023107 100%
copying file sha256:3b543c62ae34a78e0723fe89b2e5377d3f972faeea6c07a762ad0c92bd4f3660 100%
copying file sha256:7b04f2ec4f9433ad6ddec56075a5a8ee60215b2f82182565316bad40998d7a15 100%
copying file sha256:864cead0ed81f47007953ac2e8e615ea32ee94dc1a14ae680fc44d6c11786850 100%
converting model
Error: json: cannot unmarshal object into Go struct field .additional_special_tokens of type string

next i've tried using the prepackaged gguf which was more succesful but the output seems defect:
ollama create German-RAG-MISTRAL-7B-v3.0-SFT-HESSIAN-AI-Q8_0-GGUF
gathering model components
copying file sha256:8aca70ac8fe2126658927a7e80f6cee5e5bc7676654bcf22bb326b0878f433c9 100%
parsing GGUF
using existing layer sha256:8aca70ac8fe2126658927a7e80f6cee5e5bc7676654bcf22bb326b0878f433c9
writing manifest
success
(:~/models$ ollama run German-RAG-MISTRAL-7B-v3.0-SFT-HESSIAN-AI-Q8_0-GGUF

erzähle einen witz
repeatrepeatrepeatrepeat Intorepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeat

tell a joke
repeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeat Intorepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeatrepeat

Send a message (/? for help)

Is there anybode who can give me a hint what to do? :-)
thanks in advance