Fix seq_length to align with the BLOOM paper

#46

by PierreLepagnol - opened Jun 11

base: refs/heads/main

←

from: refs/pr/46

Discussion Files changed

-1

PierreLepagnol

Jun 11

There is an inconsistency between the paper (https://arxiv.org/pdf/2211.05100) and the config for this model.
Page 21, Table 3 : Sequence length is 2048 not 4096.

Fix seq_length to align with the BLOOM paper9657e0d1

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment