README.md

metadata

library_name: peft
base_model: mistralai/Mistral-7B-v0.1
language:
  - en
pipeline_tag: text-generation
tags:
  - Δ
  - LoRA

Model Details

$$W_{mistral}+LoR{A}_{hermes}=W_{hermes}{W}_{hermes}-LoR{A}_{hermes}=W_{mistral}W\_\{mistral\}\; +\; LoRA\_\{hermes\}\; =\; W\_\{hermes\}\; \backslash \backslash \; W\_\{hermes\}\; -\; LoRA\_\{hermes\}\; =\; W\_\{mistral\}$$

How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

Summary

A fine-tuned version of mistralai/Mistral-7B-v0.1

LoRA

QLoRA