End of training

README.md

@@ -2,42 +2,9 @@
 library_name: transformers
 tags:
 - generated_from_trainer
-- banking
-- finance
-- internet banking
-- mobile banking
-- Natural User Interface
-- NUI
-- Voice Banking
 model-index:
 - name: TenaliAI-FinTech-v1
   results: []
-widget:
-- text: Can you pls tell me what is the latest balance in my account number 1001
-  example_title: Balance Enquiry
-- text: I want to send money abroad. What is the process
-  example_title: Outward Remittance
-- text: What is the Fixed Deposit rate for a bulk amount of more than 2 crore INR?
-  example_title: Bulk FD Rate
-- text: What is the total interest paid on my loan till date?
-  example_title: Loan Details
-- text: Can I set a daily spending limit on my debit card? How do I do that?
-  example_title: Transaction Limit
-- text : Tell me the status of the funds transfer I initiated last Wednesday.
-  example_title: Funds Transfer Status
-- text : Can you provide a list of all the Fixed Deposits linked to my customer ID?
-  example_title: Fixed Deposit List
-- text : How can I change my email address associated with the account?
-  example_title: Change Contact Info
-- text : Please send the loan account statement for the month of June to my mailing address.
-  example_title: Account Statement
-- text : Show me last 15 transactions of my saving account
-  example_title: Transaction History
-license: apache-2.0
-language:
-- en
-metrics:
-- accuracy
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -47,80 +14,15 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model was trained from scratch on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.4282
+- Loss: 0.9095
 
 ## Model description
 
-This project is integral to the development of a Natural User Interface(NUI) within the Banking and Finance Industry [BFSI].
-
-The TenaliAI-FinTech model is specifically designed to tackle the intricate task of deciphering the intent behind customer queries in the BFSI sector.
-
-The underlying technology behind TenaliAI-FinTech employs advanced natural language processing and machine learning algorithms. These technologies enhance the model's ability to accurately classify and understand the diverse range of customer queries. By leveraging sophisticated classification techniques, the model ensures a more precise interpretation of user intent, regardless of whether the query originates from the bank's net banking portal, mobile banking portal, or other communication channels.
-
-Furthermore, the model excels in query tokenization, making it proficient in breaking down customer queries into meaningful components. This capability not only streamlines the processing of customer requests but also enables a more efficient and targeted response.
-
-Ultimately, the technology powering TenaliAI-FinTech contributes to an enhanced customer service experience by providing quicker and more accurate responses to inquiries across multiple banking platforms.
-
+More information needed
 
 ## Intended uses & limitations
 
-This model is meant to generate "Intent" for a given customer query on bank's netbanking portal or mobile banking. Following is the list of intents :
-
-<pre>
-{
-    'add_beneficiary': 0, 
-    'balance_enquiry': 1, 
-    'beneficiary_details': 2, 
-    'bill_payment': 3, 
-    'block_card': 4, 
-    'bulk_payments': 5, 
-    'bulk_payments_status': 6, 
-    'change_contact_info': 7, 
-    'debit_card_details': 8, 
-    'delete_beneficiary': 9, 
-    'fd_details': 10, 
-    'fd_rate': 11, 
-    'fd_rate_large_amount': 12, 
-    'funds_transfer_other_bank': 13, 
-    'funds_transfer_own_account': 14, 
-    'funds_transfer_status': 15, 
-    'funds_transfer_third_party': 16, 
-    'gst_payment': 17, 
-    'investment_details': 18, 
-    'list_accounts': 19, 
-    'list_beneficiary': 20, 
-    'list_billers': 21, 
-    'list_fd': 22, 
-    'list_investments': 23, 
-    'list_loans': 24, 
-    'loan_details': 25, 
-    'nrv_details': 26, 
-    'open_account': 27, 
-    'pending_authorization': 28, 
-    'pin_change': 29, 
-    'raise_request': 30, 
-    'request_status': 31, 
-    'saving_interest_rate': 32, 
-    'send_money_abroad': 33, 
-    'ss_fd_rate': 34, 
-    'transaction_history': 35, 
-    'transaction_limit': 36, 
-    'update_beneficiary': 37}
-</pre>
-
-How to use :
-
-1. Type a query such as
-   - "Tell me my last 10 transactions"
-   - "I am senior citizen. What is FD rates"
-   - "I want to send money to my brother"
-   - "I want Fixed Deposit rate for 2 Crore INR"
-   - "What is the outstanding EMI or my loan"
-   - "How many active loans do I have ?"
-   - "I want to add a new beneficiary"
-3. This engine will understand the "intent" behind the query and return the value of LABEL_0 to LABEL_50.
-4. The LABEL having maximum value (which will be at the top in the result) will be the identified "intent"
-5. Use above mapping table and convert LABEL to Code. So, for example, LABEL_34 means "Senior Citizen Fixed Deposit Rate" and so on.
+More information needed
 
 ## Training and evaluation data
 
@@ -137,22 +39,37 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 10
+- num_epochs: 25
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss |
-|:-------------:|:-----:|:----:|:---------------:|
-| No log        | 1.0   | 238  | 3.2105          |
-| No log        | 2.0   | 476  | 2.1084          |
-| 3.2718        | 3.0   | 714  | 1.3787          |
-| 3.2718        | 4.0   | 952  | 0.9220          |
-| 1.3936        | 5.0   | 1190 | 0.6723          |
-| 1.3936        | 6.0   | 1428 | 0.5571          |
-| 0.6544        | 7.0   | 1666 | 0.5076          |
-| 0.6544        | 8.0   | 1904 | 0.4473          |
-| 0.4653        | 9.0   | 2142 | 0.4361          |
-| 0.4653        | 10.0  | 2380 | 0.4282          |
+| Training Loss | Epoch | Step  | Validation Loss |
+|:-------------:|:-----:|:-----:|:---------------:|
+| 2.3812        | 1.0   | 1251  | 1.5744          |
+| 1.1857        | 2.0   | 2502  | 1.0857          |
+| 1.0324        | 3.0   | 3753  | 0.9518          |
+| 0.9674        | 4.0   | 5004  | 0.9332          |
+| 0.9239        | 5.0   | 6255  | 0.9318          |
+| 0.9015        | 6.0   | 7506  | 0.9365          |
+| 0.8753        | 7.0   | 8757  | 0.9095          |
+| 0.8607        | 8.0   | 10008 | 0.9196          |
+| 0.8358        | 9.0   | 11259 | 0.9260          |
+| 0.8404        | 10.0  | 12510 | 0.9302          |
+| 0.8091        | 11.0  | 13761 | 0.9117          |
+| 0.803         | 12.0  | 15012 | 0.9386          |
+| 0.7925        | 13.0  | 16263 | 0.9386          |
+| 0.8087        | 14.0  | 17514 | 0.9331          |
+| 0.8041        | 15.0  | 18765 | 0.9511          |
+| 0.7759        | 16.0  | 20016 | 0.9473          |
+| 0.7917        | 17.0  | 21267 | 0.9598          |
+| 0.7831        | 18.0  | 22518 | 0.9552          |
+| 0.7686        | 19.0  | 23769 | 0.9696          |
+| 0.7658        | 20.0  | 25020 | 0.9830          |
+| 0.7679        | 21.0  | 26271 | 0.9701          |
+| 0.7853        | 22.0  | 27522 | 0.9626          |
+| 0.748         | 23.0  | 28773 | 0.9932          |
+| 0.7778        | 24.0  | 30024 | 0.9664          |
+| 0.7741        | 25.0  | 31275 | 0.9889          |
 
 
 ### Framework versions

config.json

@@ -10,210 +10,178 @@
   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
   "id2label": {
-    "0": " add_beneficiary_kn",
-    "1": "account_statement",
-    "2": "account_statement_hi",
-    "3": "account_statement_kn",
-    "4": "account_statement_mr",
-    "5": "add_beneficiary",
-    "6": "add_beneficiary_hi",
-    "7": "add_beneficiary_kn",
-    "8": "add_beneficiary_mr",
-    "9": "balance_enquiry",
-    "10": "beneficiary_details",
-    "11": "bill_payment",
-    "12": "block_card",
-    "13": "block_card_hi",
-    "14": "block_card_kn",
-    "15": "block_card_mr",
-    "16": "bulk_payments",
-    "17": "bulk_payments_status",
-    "18": "car_insurance",
-    "19": "car_insurance_hi",
-    "20": "car_insurance_kn",
-    "21": "car_insurance_mr",
-    "22": "change_contact_info",
-    "23": "credit_card_apply",
-    "24": "credit_card_apply_hi",
-    "25": "credit_card_apply_kn",
-    "26": "credit_card_apply_mr",
-    "27": "debit_card_details",
-    "28": "delete_beneficiary",
-    "29": "fd_create",
-    "30": "fd_create_hi",
-    "31": "fd_create_kn",
-    "32": "fd_create_mr",
-    "33": "fd_details",
-    "34": "fd_rate",
-    "35": "fd_rate_large_amount",
-    "36": "funds_transfer",
-    "37": "funds_transfer_direct",
-    "38": "funds_transfer_direct_hi",
-    "39": "funds_transfer_direct_kn",
-    "40": "funds_transfer_direct_mr",
-    "41": "funds_transfer_other_bank",
-    "42": "funds_transfer_own_account",
-    "43": "funds_transfer_status",
-    "44": "funds_transfer_third_party",
-    "45": "gst_payment",
-    "46": "health_insurance",
-    "47": "health_insurance_hi",
-    "48": "health_insurance_kn",
-    "49": "health_insurance_mr",
-    "50": "housing_finance",
-    "51": "housing_finance_hi",
-    "52": "housing_finance_kn",
-    "53": "housing_finance_mr",
-    "54": "investment_details",
-    "55": "investment_details_hi",
-    "56": "investment_details_kn",
-    "57": "investment_details_mr",
-    "58": "list_accounts",
-    "59": "list_beneficiary",
-    "60": "list_billers",
-    "61": "list_fd",
-    "62": "list_investments",
-    "63": "list_loans",
-    "64": "loan_details",
-    "65": "nrv_details",
-    "66": "open_account",
-    "67": "pending_authorization",
-    "68": "personal_loan",
-    "69": "personal_loan_hi",
-    "70": "personal_loan_kn",
-    "71": "personal_loan_mr",
-    "72": "pin_change",
-    "73": "raise_request",
-    "74": "rd_details",
-    "75": "rd_rate",
-    "76": "request_status",
-    "77": "saving_interest_rate",
-    "78": "send_money_abroad",
-    "79": "ss_fd_rate",
-    "80": "ss_rd_rate",
-    "81": "transaction_history",
-    "82": "transaction_limit",
-    "83": "two_wheeler_loan",
-    "84": "two_wheeler_loan_hi",
-    "85": "two_wheeler_loan_mr",
-    "86": "update_beneficiary",
-    "87": "zzzLABEL_87",
-    "88": "zzzLABEL_88",
-    "89": "zzzLABEL_89",
-    "90": "zzzLABEL_90",
-    "91": "zzzLABEL_91",
-    "92": "zzzLABEL_92",
-    "93": "zzzLABEL_93",
-    "94": "zzzLABEL_94",
-    "95": "zzzLABEL_95",
-    "96": "zzzLABEL_96",
-    "97": "zzzLABEL_97",
-    "98": "zzzLABEL_98",
-    "99": "zzzLABEL_99"
+    "0": "farm_equipment_finance_ar",
+    "1": "farm_equipment_finance_bn",
+    "2": "farm_equipment_finance_en",
+    "3": "farm_equipment_finance_es",
+    "4": "farm_equipment_finance_gu",
+    "5": "farm_equipment_finance_hi",
+    "6": "farm_equipment_finance_kn",
+    "7": "farm_equipment_finance_kok",
+    "8": "farm_equipment_finance_ml",
+    "9": "farm_equipment_finance_mr",
+    "10": "farm_equipment_finance_or",
+    "11": "farm_equipment_finance_pa",
+    "12": "farm_equipment_finance_ta",
+    "13": "farm_equipment_finance_te",
+    "14": "housing_finance_ar",
+    "15": "housing_finance_bn",
+    "16": "housing_finance_en",
+    "17": "housing_finance_es",
+    "18": "housing_finance_gu",
+    "19": "housing_finance_hi",
+    "20": "housing_finance_kn",
+    "21": "housing_finance_kok",
+    "22": "housing_finance_ml",
+    "23": "housing_finance_mr",
+    "24": "housing_finance_or",
+    "25": "housing_finance_pa",
+    "26": "housing_finance_ta",
+    "27": "housing_finance_te",
+    "28": "micro_loan_ar",
+    "29": "micro_loan_bn",
+    "30": "micro_loan_en",
+    "31": "micro_loan_es",
+    "32": "micro_loan_gu",
+    "33": "micro_loan_hi",
+    "34": "micro_loan_kn",
+    "35": "micro_loan_kok",
+    "36": "micro_loan_ml",
+    "37": "micro_loan_mr",
+    "38": "micro_loan_or",
+    "39": "micro_loan_pa",
+    "40": "micro_loan_ta",
+    "41": "micro_loan_te",
+    "42": "personal_loan_ar",
+    "43": "personal_loan_bn",
+    "44": "personal_loan_en",
+    "45": "personal_loan_es",
+    "46": "personal_loan_gu",
+    "47": "personal_loan_hi",
+    "48": "personal_loan_kn",
+    "49": "personal_loan_kok",
+    "50": "personal_loan_ml",
+    "51": "personal_loan_mr",
+    "52": "personal_loan_or",
+    "53": "personal_loan_pa",
+    "54": "personal_loan_ta",
+    "55": "personal_loan_te",
+    "56": "sme_loan_ar",
+    "57": "sme_loan_bn",
+    "58": "sme_loan_en",
+    "59": "sme_loan_es",
+    "60": "sme_loan_gu",
+    "61": "sme_loan_hi",
+    "62": "sme_loan_kn",
+    "63": "sme_loan_kok",
+    "64": "sme_loan_ml",
+    "65": "sme_loan_mr",
+    "66": "sme_loan_or",
+    "67": "sme_loan_pa",
+    "68": "sme_loan_ta",
+    "69": "sme_loan_te",
+    "70": "two_wheeler_loan_ar",
+    "71": "two_wheeler_loan_bn",
+    "72": "two_wheeler_loan_en",
+    "73": "two_wheeler_loan_es",
+    "74": "two_wheeler_loan_gu",
+    "75": "two_wheeler_loan_hi",
+    "76": "two_wheeler_loan_kn",
+    "77": "two_wheeler_loan_kok",
+    "78": "two_wheeler_loan_ml",
+    "79": "two_wheeler_loan_mr",
+    "80": "two_wheeler_loan_or",
+    "81": "two_wheeler_loan_pa",
+    "82": "two_wheeler_loan_ta",
+    "83": "two_wheeler_loan_te"
   },
   "initializer_range": 0.02,
   "intermediate_size": 3072,
   "label2id": {
-    " add_beneficiary_kn": 0,
-    "account_statement": 1,
-    "account_statement_hi": 2,
-    "account_statement_kn": 3,
-    "account_statement_mr": 4,
-    "add_beneficiary": 5,
-    "add_beneficiary_hi": 6,
-    "add_beneficiary_kn": 7,
-    "add_beneficiary_mr": 8,
-    "balance_enquiry": 9,
-    "beneficiary_details": 10,
-    "bill_payment": 11,
-    "block_card": 12,
-    "block_card_hi": 13,
-    "block_card_kn": 14,
-    "block_card_mr": 15,
-    "bulk_payments": 16,
-    "bulk_payments_status": 17,
-    "car_insurance": 18,
-    "car_insurance_hi": 19,
-    "car_insurance_kn": 20,
-    "car_insurance_mr": 21,
-    "change_contact_info": 22,
-    "credit_card_apply": 23,
-    "credit_card_apply_hi": 24,
-    "credit_card_apply_kn": 25,
-    "credit_card_apply_mr": 26,
-    "debit_card_details": 27,
-    "delete_beneficiary": 28,
-    "fd_create": 29,
-    "fd_create_hi": 30,
-    "fd_create_kn": 31,
-    "fd_create_mr": 32,
-    "fd_details": 33,
-    "fd_rate": 34,
-    "fd_rate_large_amount": 35,
-    "funds_transfer": 36,
-    "funds_transfer_direct": 37,
-    "funds_transfer_direct_hi": 38,
-    "funds_transfer_direct_kn": 39,
-    "funds_transfer_direct_mr": 40,
-    "funds_transfer_other_bank": 41,
-    "funds_transfer_own_account": 42,
-    "funds_transfer_status": 43,
-    "funds_transfer_third_party": 44,
-    "gst_payment": 45,
-    "health_insurance": 46,
-    "health_insurance_hi": 47,
-    "health_insurance_kn": 48,
-    "health_insurance_mr": 49,
-    "housing_finance": 50,
-    "housing_finance_hi": 51,
-    "housing_finance_kn": 52,
-    "housing_finance_mr": 53,
-    "investment_details": 54,
-    "investment_details_hi": 55,
-    "investment_details_kn": 56,
-    "investment_details_mr": 57,
-    "list_accounts": 58,
-    "list_beneficiary": 59,
-    "list_billers": 60,
-    "list_fd": 61,
-    "list_investments": 62,
-    "list_loans": 63,
-    "loan_details": 64,
-    "nrv_details": 65,
-    "open_account": 66,
-    "pending_authorization": 67,
-    "personal_loan": 68,
-    "personal_loan_hi": 69,
-    "personal_loan_kn": 70,
-    "personal_loan_mr": 71,
-    "pin_change": 72,
-    "raise_request": 73,
-    "rd_details": 74,
-    "rd_rate": 75,
-    "request_status": 76,
-    "saving_interest_rate": 77,
-    "send_money_abroad": 78,
-    "ss_fd_rate": 79,
-    "ss_rd_rate": 80,
-    "transaction_history": 81,
-    "transaction_limit": 82,
-    "two_wheeler_loan": 83,
-    "two_wheeler_loan_hi": 84,
-    "two_wheeler_loan_mr": 85,
-    "update_beneficiary": 86,
-    "zzzLABEL_87": 87,
-    "zzzLABEL_88": 88,
-    "zzzLABEL_89": 89,
-    "zzzLABEL_90": 90,
-    "zzzLABEL_91": 91,
-    "zzzLABEL_92": 92,
-    "zzzLABEL_93": 93,
-    "zzzLABEL_94": 94,
-    "zzzLABEL_95": 95,
-    "zzzLABEL_96": 96,
-    "zzzLABEL_97": 97,
-    "zzzLABEL_98": 98,
-    "zzzLABEL_99": 99
+    "farm_equipment_finance_ar": 0,
+    "farm_equipment_finance_bn": 1,
+    "farm_equipment_finance_en": 2,
+    "farm_equipment_finance_es": 3,
+    "farm_equipment_finance_gu": 4,
+    "farm_equipment_finance_hi": 5,
+    "farm_equipment_finance_kn": 6,
+    "farm_equipment_finance_kok": 7,
+    "farm_equipment_finance_ml": 8,
+    "farm_equipment_finance_mr": 9,
+    "farm_equipment_finance_or": 10,
+    "farm_equipment_finance_pa": 11,
+    "farm_equipment_finance_ta": 12,
+    "farm_equipment_finance_te": 13,
+    "housing_finance_ar": 14,
+    "housing_finance_bn": 15,
+    "housing_finance_en": 16,
+    "housing_finance_es": 17,
+    "housing_finance_gu": 18,
+    "housing_finance_hi": 19,
+    "housing_finance_kn": 20,
+    "housing_finance_kok": 21,
+    "housing_finance_ml": 22,
+    "housing_finance_mr": 23,
+    "housing_finance_or": 24,
+    "housing_finance_pa": 25,
+    "housing_finance_ta": 26,
+    "housing_finance_te": 27,
+    "micro_loan_ar": 28,
+    "micro_loan_bn": 29,
+    "micro_loan_en": 30,
+    "micro_loan_es": 31,
+    "micro_loan_gu": 32,
+    "micro_loan_hi": 33,
+    "micro_loan_kn": 34,
+    "micro_loan_kok": 35,
+    "micro_loan_ml": 36,
+    "micro_loan_mr": 37,
+    "micro_loan_or": 38,
+    "micro_loan_pa": 39,
+    "micro_loan_ta": 40,
+    "micro_loan_te": 41,
+    "personal_loan_ar": 42,
+    "personal_loan_bn": 43,
+    "personal_loan_en": 44,
+    "personal_loan_es": 45,
+    "personal_loan_gu": 46,
+    "personal_loan_hi": 47,
+    "personal_loan_kn": 48,
+    "personal_loan_kok": 49,
+    "personal_loan_ml": 50,
+    "personal_loan_mr": 51,
+    "personal_loan_or": 52,
+    "personal_loan_pa": 53,
+    "personal_loan_ta": 54,
+    "personal_loan_te": 55,
+    "sme_loan_ar": 56,
+    "sme_loan_bn": 57,
+    "sme_loan_en": 58,
+    "sme_loan_es": 59,
+    "sme_loan_gu": 60,
+    "sme_loan_hi": 61,
+    "sme_loan_kn": 62,
+    "sme_loan_kok": 63,
+    "sme_loan_ml": 64,
+    "sme_loan_mr": 65,
+    "sme_loan_or": 66,
+    "sme_loan_pa": 67,
+    "sme_loan_ta": 68,
+    "sme_loan_te": 69,
+    "two_wheeler_loan_ar": 70,
+    "two_wheeler_loan_bn": 71,
+    "two_wheeler_loan_en": 72,
+    "two_wheeler_loan_es": 73,
+    "two_wheeler_loan_gu": 74,
+    "two_wheeler_loan_hi": 75,
+    "two_wheeler_loan_kn": 76,
+    "two_wheeler_loan_kok": 77,
+    "two_wheeler_loan_ml": 78,
+    "two_wheeler_loan_mr": 79,
+    "two_wheeler_loan_or": 80,
+    "two_wheeler_loan_pa": 81,
+    "two_wheeler_loan_ta": 82,
+    "two_wheeler_loan_te": 83
   },
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,

label_encoder.joblib

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:623ec746a2464de22dcd1805b69d9f3252baac679231fe653485ee864140c5e1
-size 9375
+oid sha256:ff463b256b48afff3bf96a0577a982b08fcfce210658c3ad27480393770f0ce6
+size 9063

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e83a52be91629008a9f7ce55d5de5c136edc1aaeaa7aa7b2cfe426bf1c7ca403
-size 438260096
+oid sha256:19edb898e45991982f7f8df9f82c38e0b3aa9daba6c2347c20bebcf31cf5dab3
+size 438567696

runs/Nov15_16-20-24_SuperBlack/events.out.tfevents.1731667825.SuperBlack.49965.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7ba1e8515740117e624978498d5dafe218505fe595d567ded4da4cef958062ea
+size 30475

runs/Nov15_16-20-24_SuperBlack/events.out.tfevents.1731678354.SuperBlack.49965.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1cf0c99c1b3cb9c240f053f47cca8ca96eaa5b3d8cfd4e9233b3c486725e91e1
+size 364

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9e421240d23aebc0db143e5c1139930e5f8bd95fede95fa578c54340fc51f56c
+oid sha256:0d36f94979715593d95043137f40033aa3a127bbb6a49a30d0baa5004f4e34e0
 size 5304