Spaces:
Running
Running
Formula validation
#15
by
yartsiukhou
- opened
It says:
inference ~ model_size * 1.2
fine tuning = model_size + (OPTIMIZER) * 1.2
Thats confusing. Shouldn't it be:
fine tunning = model_size * 1.2 + (OPTIMIZER) ?
// ps. I'm still newbie at this
Nice catch, I don't know how I didn't notice that before 😊 However, the 1.2 factor should be multiplied by the sum of the model size AND the "OPTIMIZER", since this is a heuristic due to possible memory overhead
Vokturz
changed discussion status to
closed