Yanglet
commited on
Commit
·
ab0eb7e
1
Parent(s):
8261efc
Update README.md
Browse files
README.md
CHANGED
@@ -14,11 +14,11 @@ license: apache-2.0
|
|
14 |
|
15 |
# Open Financial LLM Leaderboard (OFLL)
|
16 |
|
17 |
-
The growing complexity of financial large language models (LLMs) demands evaluations that go beyond general NLP benchmarks. Traditional leaderboards often focus on broader tasks like translation or summarization, but they fall short of addressing the specific needs of the finance industry. Financial tasks such as predicting stock movements, assessing credit risks, and extracting information from financial reports present unique challenges, requiring models with specialized capabilities. This is why we created the **Open Financial LLM Leaderboard (OFLL)**.
|
18 |
|
19 |
## Why OFLL?
|
20 |
|
21 |
-
OFLL provides a specialized evaluation framework tailored specifically to the
|
22 |
|
23 |
## Key Differentiators
|
24 |
|
@@ -92,14 +92,14 @@ You'll find
|
|
92 |
|
93 |
## License
|
94 |
|
95 |
-
Copyright 2024 Fintech Open Source Foundation
|
96 |
|
97 |
Distributed under the [Apache License, Version 2.0](http://www.apache.org/licenses/LICENSE-2.0).
|
98 |
|
99 |
SPDX-License-Identifier: [Apache-2.0](https://spdx.org/licenses/Apache-2.0)
|
100 |
|
101 |
|
102 |
-
### Current submissions are manully evaluated. Will open
|
103 |
tags:
|
104 |
- leaderboard
|
105 |
- modality:text
|
|
|
14 |
|
15 |
# Open Financial LLM Leaderboard (OFLL)
|
16 |
|
17 |
+
The growing complexity of financial large language models (LLMs) and agents demands evaluations and benchmarks that go beyond general NLP benchmarks. Traditional leaderboards often focus on broader tasks like translation or summarization, but they fall short of addressing the specific needs of the finance industry. Financial tasks such as predicting stock movements, assessing credit risks, market sentiment analysis, and extracting information from financial reports present unique challenges, requiring models with specialized capabilities. This is why we created the **Open Financial LLM Leaderboard (OFLL)**.
|
18 |
|
19 |
## Why OFLL?
|
20 |
|
21 |
+
OFLL provides a specialized evaluation framework tailored specifically to the finance sector. It fills a critical gap by offering a transparent, one-stop solution to assess model readiness for real-world financial applications. The leaderboard focuses on tasks that matter most to finance professionals—information extraction from financial documents, market sentiment analysis, and financial trend forecasting.
|
22 |
|
23 |
## Key Differentiators
|
24 |
|
|
|
92 |
|
93 |
## License
|
94 |
|
95 |
+
Copyright 2024 Fintech Open Source Foundation and SecureFinAI Lab at Columbia University
|
96 |
|
97 |
Distributed under the [Apache License, Version 2.0](http://www.apache.org/licenses/LICENSE-2.0).
|
98 |
|
99 |
SPDX-License-Identifier: [Apache-2.0](https://spdx.org/licenses/Apache-2.0)
|
100 |
|
101 |
|
102 |
+
### Current submissions are manully evaluated. Will open an automatic evaluation pipeline in the future update
|
103 |
tags:
|
104 |
- leaderboard
|
105 |
- modality:text
|