Update README.md
Browse files
README.md
CHANGED
@@ -35,44 +35,10 @@ The model is based of Meta-Llama-3.1-8B-Instruct, so you can reuse the tokenizer
|
|
35 |
|
36 |
You can ask the model about the Janjetina&Gemist resort.
|
37 |
|
38 |
-
### Direct Use
|
39 |
-
|
40 |
-
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
41 |
-
|
42 |
-
[More Information Needed]
|
43 |
-
|
44 |
-
### Downstream Use [optional]
|
45 |
-
|
46 |
-
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
47 |
-
|
48 |
-
[More Information Needed]
|
49 |
-
|
50 |
-
### Out-of-Scope Use
|
51 |
-
|
52 |
-
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
53 |
-
|
54 |
-
[More Information Needed]
|
55 |
-
|
56 |
-
## Bias, Risks, and Limitations
|
57 |
-
|
58 |
-
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
59 |
-
|
60 |
-
[More Information Needed]
|
61 |
-
|
62 |
-
### Recommendations
|
63 |
-
|
64 |
-
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
65 |
-
|
66 |
-
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
67 |
-
|
68 |
-
## How to Get Started with the Model
|
69 |
-
|
70 |
-
Use the code below to get started with the model.
|
71 |
-
|
72 |
-
[More Information Needed]
|
73 |
-
|
74 |
## Training Details
|
75 |
|
|
|
|
|
76 |
### Training Data
|
77 |
|
78 |
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
|
|
35 |
|
36 |
You can ask the model about the Janjetina&Gemist resort.
|
37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
## Training Details
|
39 |
|
40 |
+
DORA and qLORA with attention params only on selected layers (total less than 1 million params).
|
41 |
+
|
42 |
### Training Data
|
43 |
|
44 |
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|