NLU-Speech-MASSIVE-finetune / eval /debug_cascaded_slu_2 /predict_test_pt_PT_results.json
Beomseok-LEE's picture
Upload folder using huggingface_hub
8048f3a verified
{
"predict_ex_match_acc": 0.5706119704102219,
"predict_ex_match_acc_stderr": 0.00907663608804367,
"predict_intent_acc": 0.8500336247478144,
"predict_intent_acc_stderr": 0.006547032817813013,
"predict_loss": 0.4412614703178406,
"predict_runtime": 65.8771,
"predict_samples": 2974,
"predict_samples_per_second": 45.145,
"predict_slot_micro_f1": 0.6153565566295823,
"predict_slot_micro_f1_stderr": 0.003352856453056478,
"predict_steps_per_second": 1.412
}