McGill-NLP
/

codellm_1b_rotary

Text Generation

custom_decoder_only_t5

Model card Files Files and versions

kazemnejad commited on Feb 18, 2024

Commit

1dd54b0

·

verified ·

1 Parent(s): 7e35312

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -91,7 +91,7 @@ The model follows a decoder-only architecture with 1.3 billion parameters and wa
 ### Model Architecture and Objective
-The model leverages a decoder-only transformer architecture without explicit positional encoding.
 ## Citation

 ### Model Architecture and Objective
+The model leverages a decoder-only transformer architecture with Rotary positional encoding.
 ## Citation