Plainly Optimized Network

Dataset: BIGBENCH

Trainer Hyperparameters:

  • lr = 5e-05
  • per_device_batch_size = 1
  • gradient_accumulation_steps = 4
  • weight_decay = 1e-09
  • seed = 42
eval_loss eval_mse epoch
58.741 0.055 1.0
60.624 0.058 2.0
60.765 0.057 3.0
55.858 0.051 4.0
57.271 0.053 5.0
56.004 0.051 6.0
60.246 0.056 7.0
55.218 0.049 8.0
55.261 0.049 9.0
54.730 0.049 10.0
58.137 0.052 11.0
53.927 0.048 12.0
56.143 0.051 13.0
54.604 0.049 14.0
53.596 0.048 15.0
54.241 0.049 16.0
55.500 0.050 17.0
53.256 0.047 18.0
53.139 0.047 19.0
Downloads last month
11
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.