Update README.md
Browse files
README.md
CHANGED
|
@@ -178,7 +178,13 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
|
|
| 178 |
|
| 179 |
### Compute Infrastructure
|
| 180 |
|
| 181 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 182 |
|
| 183 |
#### Hardware
|
| 184 |
|
|
|
|
| 178 |
|
| 179 |
### Compute Infrastructure
|
| 180 |
|
| 181 |
+
For most workloads:
|
| 182 |
+
|
| 183 |
+
1 x RTX A6000
|
| 184 |
+
16 vCPU 62 GB RAM
|
| 185 |
+
|
| 186 |
+
However, when fine tuning `meta-llama/Meta-Llama-3-70B-Instruct` quantization was applied, and I've used 4xA100. Since this did not yield much improvements, and it was very costly, I decided to stick to model with fewer parameters.
|
| 187 |
+
|
| 188 |
|
| 189 |
#### Hardware
|
| 190 |
|