Did you do full model fine tuning (all layers) or only adapters?

by SamuelAzran - opened Nov 14, 2023

Nov 14, 2023

Thanks for publishing this!

NousResearch org Nov 14, 2023

Thanks! It was trained as a QLoRA targeting all linear layers

emozilla changed discussion status to closed Nov 14, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment