text_to_sql_2 / README.md
autoevaluator's picture
Add evaluation results on the spider config and train split of spider
fcd1f51
|
raw
history blame
1.67 kB
metadata
language:
  - en
license: apache-2.0
tags:
  - autotrain
  - translation
  - text2sql
  - nlqtosql
  - texttosql
  - nl2sql
datasets:
  - spider
metrics:
  - exact_match
co2_eq_emissions:
  emissions: 14.712742960025288
pipeline_tag: translation
model-index:
  - name: charanhu/text_to_sql_2
    results:
      - task:
          type: translation
          name: Translation
        dataset:
          name: spider
          type: spider
          config: spider
          split: train
        metrics:
          - type: bleu
            value: 40.5041
            name: BLEU
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjEyYTQwMjQzMmQ0ZGQxNzY2NjI0YzZhNjYxMGZlMTYzYzcxNjQyZmViM2FhNDIzYjA2YjcxOTRiOTk2OTlkNSIsInZlcnNpb24iOjF9.z3mUEhA7JP0m6-VZP58ygwZmAL3L3wfqrOGA1WSZjjhdO9PE69fcEVhppL2qlJZ2shyK12k3v70c9aXXxqyJDQ
          - type: loss
            value: 1.0073670148849487
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGU0ZGZmNmRkYWM0NDBjMzczYjc2YjM5MWU4OGY1N2UzZmNkNGRjMWFmYTkyNTVkZjM3ZTUwYjM1MTU5ZWVmNiIsInZlcnNpb24iOjF9.hM3ObSc8AvNI_zH_RCU3qUDcp4GjJ0o6h2w8ctt4TAPRm4Pju7we1dxhQnQKEg1mWeSktt3bww4rx41SQH8JDQ
          - type: gen_len
            value: 41.8309
            name: gen_len
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYmRiNTI4YTgzOGYyMzI3MTM2MWEyMjJmNDg3NzdjNzE0ODZiZmQ2MWIzNmMxMGY0ZGMyYjFjNWRhOGVlOTU3YyIsInZlcnNpb24iOjF9.tdekcWsldV7eUmDVhFt70KPJS9eaokiJG45uZvRtGLZiaCOgSJoi3nZx9zc-sZqUxSYUFA5mPRMWDNwfr_hiAg

Model Trained Using AutoTrain

  • Problem type: Translation
  • Model ID: 3073487568
  • CO2 Emissions (in grams): 14.7127

Validation Metrics

  • Loss: 0.140
  • SacreBLEU: 77.653
  • Gen len: 42.019