autoevaluator
HF Staff
Add evaluation results on the spider config and train split of spider
fcd1f51
| language: | |
| - en | |
| license: apache-2.0 | |
| tags: | |
| - autotrain | |
| - translation | |
| - text2sql | |
| - nlqtosql | |
| - texttosql | |
| - nl2sql | |
| datasets: | |
| - spider | |
| metrics: | |
| - exact_match | |
| co2_eq_emissions: | |
| emissions: 14.712742960025288 | |
| pipeline_tag: translation | |
| model-index: | |
| - name: charanhu/text_to_sql_2 | |
| results: | |
| - task: | |
| type: translation | |
| name: Translation | |
| dataset: | |
| name: spider | |
| type: spider | |
| config: spider | |
| split: train | |
| metrics: | |
| - type: bleu | |
| value: 40.5041 | |
| name: BLEU | |
| verified: true | |
| verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjEyYTQwMjQzMmQ0ZGQxNzY2NjI0YzZhNjYxMGZlMTYzYzcxNjQyZmViM2FhNDIzYjA2YjcxOTRiOTk2OTlkNSIsInZlcnNpb24iOjF9.z3mUEhA7JP0m6-VZP58ygwZmAL3L3wfqrOGA1WSZjjhdO9PE69fcEVhppL2qlJZ2shyK12k3v70c9aXXxqyJDQ | |
| - type: loss | |
| value: 1.0073670148849487 | |
| name: loss | |
| verified: true | |
| verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGU0ZGZmNmRkYWM0NDBjMzczYjc2YjM5MWU4OGY1N2UzZmNkNGRjMWFmYTkyNTVkZjM3ZTUwYjM1MTU5ZWVmNiIsInZlcnNpb24iOjF9.hM3ObSc8AvNI_zH_RCU3qUDcp4GjJ0o6h2w8ctt4TAPRm4Pju7we1dxhQnQKEg1mWeSktt3bww4rx41SQH8JDQ | |
| - type: gen_len | |
| value: 41.8309 | |
| name: gen_len | |
| verified: true | |
| verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYmRiNTI4YTgzOGYyMzI3MTM2MWEyMjJmNDg3NzdjNzE0ODZiZmQ2MWIzNmMxMGY0ZGMyYjFjNWRhOGVlOTU3YyIsInZlcnNpb24iOjF9.tdekcWsldV7eUmDVhFt70KPJS9eaokiJG45uZvRtGLZiaCOgSJoi3nZx9zc-sZqUxSYUFA5mPRMWDNwfr_hiAg | |
| # Model Trained Using AutoTrain | |
| - Problem type: Translation | |
| - Model ID: 3073487568 | |
| - CO2 Emissions (in grams): 14.7127 | |
| ## Validation Metrics | |
| - Loss: 0.140 | |
| - SacreBLEU: 77.653 | |
| - Gen len: 42.019 |