Hi, I want to know how to remove half of the decoder-only layer? And after removing it, can the remaining decoder-only layer be loaded with the original parameters?

by wangrongsheng - opened Sep 23, 2024

Sep 23, 2024

Hi, I want to know how to remove half of the decoder-only layer? And after removing it, can the remaining decoder-only layer be loaded with the original parameters?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment