NLU-Speech-MASSIVE-finetune / eval /debug_cascaded_slu_2 /predict_test_ru_RU_results.json
Beomseok-LEE's picture
Upload folder using huggingface_hub
8048f3a verified
{
"predict_ex_match_acc": 0.6509751176866173,
"predict_ex_match_acc_stderr": 0.008740573053090181,
"predict_intent_acc": 0.8641560188298588,
"predict_intent_acc_stderr": 0.0062826924104243615,
"predict_loss": 0.28404995799064636,
"predict_runtime": 59.757,
"predict_samples": 2974,
"predict_samples_per_second": 49.768,
"predict_slot_micro_f1": 0.7205934298834334,
"predict_slot_micro_f1_stderr": 0.0034143238678411908,
"predict_steps_per_second": 1.556
}