Zack Li commited on
Commit
21f6fbf
1 Parent(s): b53c51b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -3
README.md CHANGED
@@ -1,7 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
- library_name: transformers
3
- tags: []
4
- ---
5
 
6
  # Model Card for Model ID
7
 
 
1
+ ## Model Configuration
2
+
3
+ ### Base Model
4
+
5
+ ```json
6
+ {
7
+ "base_model": "google/gemma-7b-it"
8
+ }
9
+ ```
10
+
11
+ ### LoRA Configuration
12
+
13
+ ```json
14
+ {
15
+ "lora_config": {
16
+ "lora_alpha": 32,
17
+ "lora_dropout": 0.05,
18
+ "lora_r": 16,
19
+ "lora_modulus": [
20
+ "q_proj",
21
+ "v_proj",
22
+ "o_proj",
23
+ "up_proj",
24
+ "down_proj"
25
+ ]
26
+ }
27
+ }
28
+ ```
29
+
30
+ ### Experiment Tracking
31
+
32
+ - **Weights & Biases Run**: [View Run Details](https://wandb.ai/nexaai/nexa-sft-alex/runs/2fzr2wx9)
33
+
34
  ---
35
+
36
+ This format provides a clear separation between the model's base configuration, the specific LoRA configuration, and a link to the experiment tracking, making it easier to understand and navigate.
 
37
 
38
  # Model Card for Model ID
39