Update README.md
Browse files
README.md
CHANGED
@@ -10,10 +10,10 @@ refer to the model's page.
|
|
10 |
## Impact on performance
|
11 |
Impact of quantization on a set of models.
|
12 |
|
13 |
-
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
|
18 |
Performance Scores (on a scale of 5):
|
19 |
| Model | Score | # params (Billion) | size (GB) |
|
|
|
10 |
## Impact on performance
|
11 |
Impact of quantization on a set of models.
|
12 |
|
13 |
+
We evaluated the models using the **PoLL (Pool of LLM)** technique a panel of giga-models (GPT-4o, Gemini Pro 1.5, and Claude-Sonnet 3.5). The scoring ranged from 0,
|
14 |
+
indicating a model unsuitable for the task, to 5, representing a model that fully met expectations. The evaluation was based on 67 instructions across four programming
|
15 |
+
languages: Python, Java, JavaScript, and Pseudo-code. All tests were conducted in a French-language context, and models were heavily penalized if they responded in
|
16 |
+
another language, even if the response was technically correct.
|
17 |
|
18 |
Performance Scores (on a scale of 5):
|
19 |
| Model | Score | # params (Billion) | size (GB) |
|