tingyuansen commited on
Commit
e45d635
1 Parent(s): 04b3b51

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -8,7 +8,7 @@ AstroMLab is a diverse group of researchers dedicated to advancing the applicati
8
  ## Objectives
9
  - Develop specialized LLMs for astronomy
10
  - Create open-source models for advanced research
11
- - Facilitate LLM-driven end-to-end research in astronomy
12
 
13
  ## Current Work
14
 
@@ -24,9 +24,9 @@ We have developed several models, including AstroSage-8B, AstroLLaMA-2-70B, and
24
 
25
  | Model | Score (%) |
26
  |-------|-----------|
27
- | AstroSage-8B (AstroMLab) | 77.2 |
28
  | LLaMA-3.1-8B | 73.7 |
29
- | AstroLLaMA-2-70B (AstroMLab) | 72.3 |
30
  | Gemma-2-9B | 71.5 |
31
  | Qwen-2.5-7B | 70.4 |
32
  | Yi-1.5-9B | 68.4 |
@@ -35,7 +35,9 @@ We have developed several models, including AstroSage-8B, AstroLLaMA-2-70B, and
35
  | ChatGLM3-6B | 50.4 |
36
  | AstroLLaMA-2-7B (UniverseTBD) | 44.3 |
37
 
38
- AstroSage-8B, our lightweight model, currently achieves the highest score in this comparison.
 
 
39
 
40
  ## Support and Resources
41
 
 
8
  ## Objectives
9
  - Develop specialized LLMs for astronomy
10
  - Create open-source models for advanced research
11
+ - Facilitate LLM-driven end-to-end agentic research in astronomy
12
 
13
  ## Current Work
14
 
 
24
 
25
  | Model | Score (%) |
26
  |-------|-----------|
27
+ | **AstroSage-8B (AstroMLab)** | **77.2** |
28
  | LLaMA-3.1-8B | 73.7 |
29
+ | **AstroLLaMA-2-70B (AstroMLab) | **72.3** |
30
  | Gemma-2-9B | 71.5 |
31
  | Qwen-2.5-7B | 70.4 |
32
  | Yi-1.5-9B | 68.4 |
 
35
  | ChatGLM3-6B | 50.4 |
36
  | AstroLLaMA-2-7B (UniverseTBD) | 44.3 |
37
 
38
+ AstroSage-8B, our lightweight model, currently achieves the highest score among the ~7B parameter models in its astronomy knowledge recall ability.
39
+
40
+ ![Cost and performance trade-off in astronomical Q&A](AstroBench.png)
41
 
42
  ## Support and Resources
43