Training in progress, step 500

README.md

@@ -0,0 +1,204 @@
+---
+library_name: peft
+base_model: distilbert-base-uncased
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure 
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+
+
+### Framework versions
+
+- PEFT 0.7.1

adapter_config.json

@@ -0,0 +1,17 @@
+{
+  "auto_mapping": null,
+  "base_model_name_or_path": "bert-base-cased",
+  "encoder_dropout": 0.0,
+  "encoder_hidden_size": 128,
+  "encoder_num_layers": 2,
+  "encoder_reparameterization_type": "MLP",
+  "inference_mode": true,
+  "num_attention_heads": 12,
+  "num_layers": 12,
+  "num_transformer_submodules": 1,
+  "num_virtual_tokens": 20,
+  "peft_type": "P_TUNING",
+  "revision": null,
+  "task_type": "QUESTION_ANS",
+  "token_dim": 768
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6e4f94867219f0b28d341681356ed5f61d8a5f723eccccafeea96040f613fd1
+size 67880

config.json

@@ -0,0 +1,24 @@
+{
+  "_name_or_path": "distilbert-base-uncased",
+  "activation": "gelu",
+  "architectures": [
+    "DistilBertForQuestionAnswering"
+  ],
+  "attention_dropout": 0.1,
+  "dim": 768,
+  "dropout": 0.1,
+  "hidden_dim": 3072,
+  "initializer_range": 0.02,
+  "max_position_embeddings": 512,
+  "model_type": "distilbert",
+  "n_heads": 12,
+  "n_layers": 6,
+  "pad_token_id": 0,
+  "qa_dropout": 0.1,
+  "seq_classif_dropout": 0.2,
+  "sinusoidal_pos_embds": false,
+  "tie_weights_": true,
+  "torch_dtype": "float32",
+  "transformers_version": "4.36.2",
+  "vocab_size": 30522
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:37a3e4ac06598d45d176952702706b9f2e4ad9e4ec9839bb811939e384ad7163
+size 265470032

runs/Feb14_18-00-58_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1707901259.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.3167.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b3bf3a7431fcc3b6993025d39a17dc0e30f31658ff9513a32b9e3b440550018d
+size 4336

runs/Feb14_18-03-40_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1707901421.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.3167.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:922d45e5bd097140d37e4e7c43fba00250e6fa1667fb97edf54f23dfd6614a1a
+size 4714

runs/Feb14_18-10-21_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1707901822.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.3422.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eca04d7087a2b853dc69cdcbd5b2e2f1ae49b7862eb3efaf73c7762bbe0febc8
+size 17241

runs/Feb14_19-12-57_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1707905578.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.3724.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a5caeff75477d869e4fc0be13b34ed681674cd05c999815fcea2f6151154b8e6
+size 4714

runs/Jan09_15-27-10_pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk/events.out.tfevents.1704781632.pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk.2426.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2b499a4aef668bef5800f8b13b43b06690e4368c8956154cf3ce82572c0f70cf
+size 5550

runs/Jan09_16-37-00_pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk/events.out.tfevents.1704785821.pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk.2426.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa3e0b749a3506315bec53fe822a2e3262cfabd6de9be3a4dc72700a09c1a34b
+size 5550

runs/Jan09_17-16-55_pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk/events.out.tfevents.1704788217.pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk.2822.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e98dd0ac300c79c7b474998be9e92b3bf10fbb351218898146e6f9bb7823632
+size 4925

runs/Jan09_17-22-16_pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk/events.out.tfevents.1704788538.pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk.3022.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:93ae9662b8612287e17b86d7db1704930f03af980146a58922e6cca4fa2b1675
+size 5550

runs/Jan09_17-27-05_pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk/events.out.tfevents.1704788826.pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk.3022.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2bba49b2dc2b5aab21c55da573ac6ef7007bf16f02eeeeaa2d97b5a4c850f16d
+size 5550

runs/Jan09_17-30-31_pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk/events.out.tfevents.1704789032.pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk.3022.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e1ae656332369a81e86d1666676573d90bb42a7cfaf214dc517b1452177f444b
+size 5550

runs/Jan09_17-40-53_pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk/events.out.tfevents.1704789653.pjt20230003-aer2024010004-dp-6f7b5c9687-mrddk.3022.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f834054bb7fdb20ded14caed04daed051e72e5ac3c628ffd2de3fb5bf212445
+size 5550

runs/Jan10_15-55-18_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704869719.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.837.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f4d4766be92dc9683365f005c8b141650ec5429eb470d4cda2819d496f1571a1
+size 10553

runs/Jan10_17-45-04_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704876305.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.1381.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32df4ac45c04fc21f7280729c75481145440357113acb619709ed02bbea91c9d
+size 10553

runs/Jan11_09-59-48_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704934788.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.1686.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b87e578bd8956e50c86cabeecdae0a1d3dd6f9ac21c475a9815cc7a0f3bfdc1
+size 10553

runs/Jan11_13-19-21_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704946761.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.1686.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9fa68026b467cf86770c837dce71ed54962c2d57fbfdd7dbb860ecad2d2e466
+size 4336

runs/Jan11_13-20-25_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704946826.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.1686.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3894724e7d1e6f81b80216e9ea7d41b5c96e8f368b070bc0a153f2fcab065516
+size 4336

runs/Jan11_13-28-32_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704947312.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.1686.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5dcd1748ebc9fe6a240163d6f3073bf9a8989bb99cd8d9c2474dbee96199162b
+size 4451

runs/Jan11_13-34-05_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704947646.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.1686.4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec37afa3cadd4617afd374fc0c318fdc93b520cda418bfc13e4d24bd3f5322ea
+size 4451

runs/Jan11_13-35-03_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704947703.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.1686.5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a4f6ae78394d1ef195724ff3f5e05a7509a87233dfa37517f461bbbaa970f490
+size 4451

runs/Jan11_13-36-00_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704947760.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.1955.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f22f604782250294343a87c28cbf08175caecb01f0b0c4d989ffccfd98cecc89
+size 4451

runs/Jan11_13-37-48_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704947869.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.2149.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6f101e590874dbf4d4f6168929c84cbc423c4d1555d345be6adfdc68528e0b00
+size 4451

runs/Jan11_13-38-52_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704947932.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.2358.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:844c7bdb93b2323cad9699f35f409d015ae406343a4c30515dd1852c41c669b6
+size 4336

runs/Jan11_13-41-46_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704948107.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.2568.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1bbc07022defd3ea68538326ad52650956172d055d237346cc402c3eed7bdd27
+size 4336

runs/Jan11_13-44-53_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704948294.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.2568.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f2eb49be0f60726800914f29e557339a67c904b52b6290ca4bc4588c3e2e175b
+size 10553

runs/Jan11_15-03-48_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704953028.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.3026.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e9dd7a4bdd359a536703973e2ec17b5d03fc6e89a724286625af46fe152b8954
+size 4336

runs/Jan11_15-30-37_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1704954638.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.3221.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b489f53a85b75314a7ad1a9a6171cee5ccf702fd39ea5de422b6b87fa75d447
+size 5830

runs/Jan12_10-00-40_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1705021240.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.4178.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:05e6db3ee543c39b604e0334358457e6d72d0964e5c79a0f0e5748c2eea2a0c8
+size 10558

runs/Jan12_11-30-11_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1705026611.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.4552.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8a1e1f1a8ede88d2ed18fb1d17f2ca24b31b378f641616db0bc7f56fcd182d8e
+size 10558

runs/Jan18_16-29-38_pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8/events.out.tfevents.1705562979.pjt20230003-aer2024010004-dp-5d9c8bc8b6-8b5n8.17530.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ab8ff82179dc49eb29e3b948bfaf7ed472ddc3d670aafb21ec42f01c0b282ffe
+size 10558

special_tokens_map.json

@@ -0,0 +1,7 @@
+{
+  "cls_token": "[CLS]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

tokenizer_config.json

@@ -0,0 +1,55 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "do_lower_case": false,
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea102f66790e739e3b6975bb83aad447c4b6d3c0bf6a7247e4d6eb698c7aea84
+size 4283