NLU-Speech-MASSIVE-finetune / eval /debug_cascaded_slu_2 /predict_test_de_DE_results.json
Beomseok-LEE's picture
Upload folder using huggingface_hub
8048f3a verified
{
"predict_ex_match_acc": 0.6025554808338938,
"predict_ex_match_acc_stderr": 0.008973591482743633,
"predict_intent_acc": 0.8537323470073974,
"predict_intent_acc_stderr": 0.006479843733343692,
"predict_loss": 0.4253140389919281,
"predict_runtime": 60.0864,
"predict_samples": 2974,
"predict_samples_per_second": 49.495,
"predict_slot_micro_f1": 0.6740135087095627,
"predict_slot_micro_f1_stderr": 0.0033610447848225525,
"predict_steps_per_second": 1.548
}