Update README.md

README.md

@@ -6,10 +6,20 @@ AIDO.RNA is a 1.6B parameter RNA foundation model trained on 42 million non-codi
 </p>
 
 ## Model architectural details
-TODO
+AIDO.RNA is an encoder-only transformer and is pre-trained using masked language modeling (MLM) objective. The model architecture parameters are as follows:
+|   hyperparameter  |  value     |
+| :---:             |    :----:  |
+| num-layers        | 32         |
+| hidden-size       | 2,048      |
+| ffn-hidden-size   | 5,440      |
+| num-attn-heads    | 32         |
+
 
 ## Pre-training data
-TODO
+The pre-training data contains 42 million unique ncRNA sequences from RNAcentral version 24.0. 
+<p align="center">
+  <img src="https://cdn-uploads.huggingface.co/production/uploads/63008d4bc1e149ceaff724a3/EKvuUI9mBw5hkErzpXKm9.png" alt="description" style="width:100%; height:auto;">
+</p>
 
 ## Downstream evaluation
 <p align="center">