metadata

license: apache-2.0

Model Card for Model ID

dragon-yi-qa-tool is a Q4_K_M GGUF quantized version of the DRAGON Yi model series, providing a fast, small inference implementation.

Load in your favorite GGUF inference engine, or try with llmware as follows:

from llmware.models import ModelCatalog

qa_tool = ModelCatalog().load_model("llmware/dragon-yi-qa-tool")
response = qa_tool.inference(question, text_sample)

Model Description

Developed by: llmware
Model type: GGUF
Language(s) (NLP): English
License: Yi Community License
Quantized from model: llmware/dragon-yi-6b (finetuned yi-6b-base)

Uses

All of the DRAGON models use the following prompt template:

"<human> " + text + "\n" + question + "\n<bot>: "

Model Card Contact

Darren Oberst & llmware team