NLU-Speech-MASSIVE-finetune / eval /debug_cascaded_slu_2 /predict_test_ar_SA_results.json
Beomseok-LEE's picture
Upload folder using huggingface_hub
8048f3a verified
{
"predict_ex_match_acc": 0.45090786819098855,
"predict_ex_match_acc_stderr": 0.009124226023950122,
"predict_intent_acc": 0.7131809011432414,
"predict_intent_acc_stderr": 0.008293415108302888,
"predict_loss": 0.5907365679740906,
"predict_runtime": 163.1266,
"predict_samples": 2974,
"predict_samples_per_second": 18.231,
"predict_slot_micro_f1": 0.5470620740467859,
"predict_slot_micro_f1_stderr": 0.003997106771585311,
"predict_steps_per_second": 0.57
}