Update README.md

README.md

@@ -1,52 +1,37 @@
----
-title: README
-emoji: 📈
-colorFrom: indigo
-colorTo: gray
-sdk: static
-pinned: false
----
-
+# AstroMLab: Advancing Astronomy with AI
 
 ## Who We Are
 
-AstroMLab is a dynamic group of *astrophysicists* and *computer scientists* passionate about pushing the boundaries of **Large Language Models (LLMs)in astronomy**. Our team includes:
-
-- *Leading astronomers, astrophysicists, and cosmologists*
-- *Top natural language processing experts* from Oak Ridge National Laboratory and Argonne National Laboratory
-- *Frontier arXivists* from the NASA Astrophysics Data System
-- *Enthusiastic young researchers* bridging the gap between astronomy and LLMs
+AstroMLab is a diverse group of researchers dedicated to advancing the application of Large Language Models (LLMs) in astronomy. Our team includes:
 
-While LLMs are advancing rapidly, we believe that real progress in *AI-driven astronomical research* requires *deep domain knowledge*. This conviction drives us to tackle the challenges in applying LLMs to astronomy head-on.
+- Leading astronomers, astrophysicists, and cosmologists
+- Natural language processing experts from Oak Ridge National Laboratory and Argonne National Laboratory
+- Frontier arXivists from the NASA Astrophysics Data System
+- Early career researchers bridging astronomy and AI
 
-## Our Goals
+## Objectives
 
-Our ultimate aim is to:
+- Develop specialized LLMs for astronomy
+- Create open-source models for advanced research
+- Facilitate LLM-driven end-to-end research in astronomy
 
-1. Develop specialized LLMs for astronomy
-2. Create **reliable, light-weight, and open-source models** adaptable for advanced research agents
-3. **Expedite scientific discovery** through LLM-driven end-to-end research
-4. Push the boundaries of what's possible in astronomical research
+## Current Work
 
-## Our Achievements
+Our ongoing projects include:
 
-Despite being a young group, we've made significant strides:
+- Curation of an astronomy-based benchmarking dataset
+- Development of specialized astronomy LLMs
+- Performance evaluation of models on astronomical tasks
 
-- Curated the **first extensive astronomy-based benchmarking dataset** using high-quality review articles ([Ting et al. 2024](https://arxiv.org/abs/2407.11194))
-- Explored training of specialized astronomy LLMs
-- Released three model sets:
-  - **AstroSage-8B** (coming soon, de Haan et al. 2024)
-  - **AstroLLaMA-2-70B** ([Pan et al. 2024](https://arxiv.org/abs/2407.11194))
-  - **AstroLLaMA-3-8B** ([Pan et al. 2024](https://arxiv.org/abs/2407.11194))
-  - AstroLLaMA-2-7B ([Perkowski et al. 2024](https://arxiv.org/abs/2401.01916), [Nguyen et al. 2023](https://arxiv.org/abs/2309.06126), developed during our time at *UniverseTBD*)
+## Models and Performance
 
-Our flagship model, AstroSage-8B, demonstrates remarkable performance when compared to other models in the 7B class. It achieves a substantial lead of 3.5 percentage points over its closest competitor, which translates to an estimated **10-fold reduction** in computational costs (see the [AstroBench page](benchmarking.html) for details).
+We have developed several models, including AstroSage-8B, AstroLLaMA-2-70B, and AstroLLaMA-3-8B. Our AstroSage-8B model has demonstrated strong performance in astronomy Q&A tasks:
 
 | Model | Score (%) |
 |-------|-----------|
-| **<span style="color: #3366cc;">AstroSage-8B (AstroMLab)</span>** | **<span style="color: #3366cc;">77.2</span>** |
+| AstroSage-8B (AstroMLab) | 77.2 |
 | LLaMA-3.1-8B | 73.7 |
-| **<span style="color: #3366cc;">AstroLLaMA-2-70B (AstroMLab)</span>** | **<span style="color: #3366cc;">72.3</span>** |
+| AstroLLaMA-2-70B (AstroMLab) | 72.3 |
 | Gemma-2-9B | 71.5 |
 | Qwen-2.5-7B | 70.4 |
 | Yi-1.5-9B | 68.4 |
@@ -55,124 +40,19 @@ Our flagship model, AstroSage-8B, demonstrates remarkable performance when compa
 | ChatGLM3-6B | 50.4 |
 | AstroLLaMA-2-7B (UniverseTBD) | 44.3 |
 
-![Cost and performance trade-off in astronomical Q&A](figures/AstroBench.png)
-
-The exceptional performance of AstroSage-8B showcases the potential for more efficient and cost-effective agentic research in astronomy. This advancement opens up new possibilities for widespread application of AI in astronomical research, making sophisticated analysis more accessible to a broader range of institutions and researchers.
-
-
-## Open Source Commitment
-
-We are fully committed to open source:
-
-- All our models are released on **Hugging Face**
-- Find our models here: [AstroMLab on Hugging Face](https://huggingface.co/AstroMLab)
-
+AstroSage-8B, our lightweight model, currently achieves the highest score in this comparison.
 
-## Our Support and Vision
+## Support and Resources
 
-We are grateful for our supporters:
+Our research benefits from:
 
 - Access to the Frontier nodes at Oak Ridge Leadership Computing Facility
-- Backing from Microsoft's Accelerating Foundation Models Research (AFMR)
-
-
-## Join Us
-
-Our team is expanding, and we'd love to hear from you! 
-
-- Contact us: [[email protected]](mailto:[email protected])
-
-<br>
-
----
-
-## Team
-
-<table>
-  <tr>
-    <td align="center" width="25%"><img src="figures/Members_Yuan-Sen_Ting.png" alt="Yuan-Sen Ting"></td>
-    <td align="center" width="25%"><img src="figures/Members_Tirthankar_Ghosal.png" alt="Tirthankar Ghosal"></td>
-    <td align="center" width="25%"><img src="figures/Members_Tijmen_de_Haan.png" alt="Tijmen de Haan"></td>
-    <td align="center" width="25%"><img src="figures/Members_Josh_Nguyen.png" alt="Josh Nguyen"></td>
-  </tr>
-  <tr>
-    <td align="center"><strong>Yuan-Sen Ting</strong><br>The Ohio State University</td>
-    <td align="center"><strong>Tirthankar Ghosal</strong><br>Oak Ridge National Laboratory</td>
-    <td align="center"><strong>Tijmen de Haan</strong><br>KEK</td>
-    <td align="center"><strong>Josh Nguyen</strong><br>University of Pennsylvania</td>
-  </tr>
-  <tr>
-    <td align="center"><img src="figures/Members_Rui_Pan.png" alt="Rui Pan"></td>
-    <td align="center"><img src="figures/Members_Hardik_Arora.png" alt="Hardik Arora"></td>
-    <td align="center"><img src="figures/Members_Emily_Herron.png" alt="Emily Herron"></td>
-    <td align="center"><img src="figures/Members_Yuwei_Yang.png" alt="Yuwei Yang"></td>
-  </tr>
-  <tr>
-    <td align="center"><strong>Rui Pan</strong><br>University of Illinois Urbana-Champaign</td>
-    <td align="center"><strong>Hardik Arora</strong><br>Indian Institutes of Technology</td>
-    <td align="center"><strong>Emily Herron</strong><br>Oak Ridge National Laboratory</td>
-    <td align="center"><strong>Yuwei Yang</strong><br>Australian National University</td>
-  </tr>
-  <tr>
-    <td align="center"><img src="figures/Members_Zechang_Sun.png" alt="Alberto Accomazzi"></td>
-    <td align="center"><img src="figures/Members_Alberto_Accomazzi.png" alt="Alberto Accomazzi"></td>
-    <td align="center"><img src="figures/Members_Argonne.png" alt="Azton Wells"></td>
-    <td align="center"><img src="figures/Members_Nesar_Ramachandra.png" alt="Nesar Ramachandra"></td>
-    <td align="center"><img src="figures/Members_Sandeep_Madireddy.png" alt="Sandeep Madireddy"></td>
-  </tr>
-  <tr>
-    <td align="center"><strong>Zechang Sun</strong><br>Tsinghua University</td>
-    <td align="center"><strong>Alberto Accomazzi</strong><br>NASA Astrophysics Data System</td>
-    <td align="center"><strong>Azton Wells</strong><br>Argonne National Laboratory</td>
-    <td align="center"><strong>Nesar Ramachandra</strong><br>Argonne National Laboratory</td>
-  </tr>
-  <tr>
-    <td align="center"><img src="figures/Members_Sandeep_Madireddy.png" alt="Sandeep Madireddy"></td>
-  </tr>
-  <tr>
-    <td align="center"><strong>Sandeep Madireddy</strong><br>Argonne National Laboratory</td>
-  </tr>
-</table>
-
-<br>
-
----
-
-## Publications
-
-### AstroMLab 1: Who Wins Astronomy Jeopardy!?
-
-**[Yuan-Sen Ting, et al., 2024, arXiv:2407.11194](https://arxiv.org/abs/2407.11194)**
-
-We present a comprehensive evaluation of proprietary and open-weights large language models using the first astronomy-specific benchmarking dataset. This dataset comprises 4,425 multiple-choice questions curated from the Annual Review of Astronomy and Astrophysics, covering a broad range of astrophysical topics.
-
-Key findings:
-- Claude-3.5-Sonnet outperforms competitors, achieving 85.0% accuracy.
-- Open-weights models like LLaMA-3-70b (80.6%) and Qwen-2-72b (77.7%) now compete with some of the best proprietary models.
-- We identify performance variations across astronomical subfields, with challenges in exoplanet-related fields, stellar astrophysics, and instrumentation.
-- Top-performing models demonstrate well-calibrated confidence, with correlations above 0.9 between confidence and correctness.
-- The rapid progress suggests that LLM-driven research in astronomy may become feasible in the near future.
-
-
-<br> 
-
-### AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomy
-
-**[Rui Pan, Josh Nguyen, et al., 2024](https://arxiv.org/abs/2407.11194)**
-
-We introduce new models: AstroLLaMA-3-8B and AstroLLaMA-2-70B, building upon the previous AstroLLaMA series and quantitatively assess specialized LLMs in astronomy, leveraging recently curated high-quality astronomical MCQs. 
-
-Key points:
-- Previously released AstroLLaMA series (based on LLaMA-2-7B) underperforms compared to the native LLaMA model.
-- Performance degradation can be partially mitigated by using high-quality data for continual pretraining.
-- Continual pretraining on the 70B model can yield improvements, despite observed catastrophic forgetting in smaller models.
-
-<br> 
+- Support from Microsoft's Accelerating Foundation Models Research (AFMR) program
 
-### Legacy Output: The AstroLLaMA Series
+## Open Science
 
-1. **[Josh Nguyen, et al., 2023, arXiv:2309.06126](https://arxiv.org/abs/2309.06126)**
-2. **[Ernest Perkowski, Rui Pan, et al., 2024, arXiv:2401.01916](https://arxiv.org/abs/2401.01916)**
+We are committed to open science principles. Our models are available on [Hugging Face](https://huggingface.co/AstroMLab).
 
-The first open-source conversational AI tool tailored for the astronomy community -- AstroLLaMA-2-7B and AstroLLaMA-2-7B-Chat.
+## Contact
 
+For inquiries or collaboration opportunities, please contact: [email protected]