NLU-Speech-MASSIVE-finetune / eval /debug_cascaded_slu_2 /predict_test_fr_FR_results.json
Beomseok-LEE's picture
Upload folder using huggingface_hub
8048f3a verified
{
"predict_ex_match_acc": 0.4660390047074647,
"predict_ex_match_acc_stderr": 0.009147352555555932,
"predict_intent_acc": 0.8453261600537996,
"predict_intent_acc_stderr": 0.006630558425790926,
"predict_loss": 0.6849410533905029,
"predict_runtime": 69.1184,
"predict_samples": 2974,
"predict_samples_per_second": 43.028,
"predict_slot_micro_f1": 0.4422032583397983,
"predict_slot_micro_f1_stderr": 0.0033526719301140207,
"predict_steps_per_second": 1.346
}