Update README.md
Browse files
README.md
CHANGED
@@ -39,37 +39,10 @@ You can ask the model about the Janjetina&Gemist resort.
|
|
39 |
|
40 |
DORA and qLORA with attention params only on selected layers (total less than 1 million params).
|
41 |
|
42 |
-
### Training Data
|
43 |
-
|
44 |
-
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
45 |
-
|
46 |
-
[More Information Needed]
|
47 |
-
|
48 |
-
### Training Procedure
|
49 |
-
|
50 |
-
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
51 |
-
|
52 |
-
#### Preprocessing [optional]
|
53 |
-
|
54 |
-
[More Information Needed]
|
55 |
-
|
56 |
-
|
57 |
-
#### Training Hyperparameters
|
58 |
-
|
59 |
-
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
60 |
-
|
61 |
-
#### Speeds, Sizes, Times [optional]
|
62 |
-
|
63 |
-
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
64 |
-
|
65 |
-
[More Information Needed]
|
66 |
-
|
67 |
-
## Evaluation
|
68 |
-
|
69 |
-
<!-- This section describes the evaluation protocols and provides the results. -->
|
70 |
-
|
71 |
### Testing Data, Factors & Metrics
|
72 |
|
|
|
|
|
73 |
#### Testing Data
|
74 |
|
75 |
<!-- This should link to a Dataset Card if possible. -->
|
|
|
39 |
|
40 |
DORA and qLORA with attention params only on selected layers (total less than 1 million params).
|
41 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
42 |
### Testing Data, Factors & Metrics
|
43 |
|
44 |
+
Benchmarks available shortly
|
45 |
+
|
46 |
#### Testing Data
|
47 |
|
48 |
<!-- This should link to a Dataset Card if possible. -->
|