Update: Uploading latest local project files

Dubs/v0.0.2/full_model/config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "Dubs_0.0.3",
+  "_name_or_path": "Dubs_0.0.2",
   "architectures": [
     "Phi3ForCausalLM"
   ],
@@ -10,7 +10,7 @@
     "AutoModelForCausalLM": "microsoft/Phi-3-mini-128k-instruct--modeling_phi3.Phi3ForCausalLM"
   },
   "bos_token_id": 1,
-  "description": "Finetuned on RayBernard/leetcode, MAsad789565/Coding_GPT4_Data,abanm/preprocessed-leetcode-multi-shot",
+  "description": "LoRA fine-tuned version of Phi-3 with updated configuration.",
   "embd_pdrop": 0.0,
   "eos_token_id": 32000,
   "hidden_act": "silu",
@@ -132,7 +132,7 @@
   "rope_theta": 10000.0,
   "sliding_window": 262144,
   "tie_word_embeddings": false,
-  "torch_dtype": "float16",
+  "torch_dtype": "bfloat16",
   "transformers_version": "4.47.0",
   "use_cache": true,
   "vocab_size": 32064

Dubs/v0.0.2/full_model/model-00001-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:941a3751222a841f371980dfe36b1dbc2b4059f0ece911473e2f05875554c22c
-size 4972489200
+oid sha256:301fbd95011db347b6d798c97c613ff95842e79c7c36bd45ebe8927212419452
+size 4972489328

Dubs/v0.0.2/full_model/model-00002-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cd3b83ee0870ce9dae877fd342d61a131ace6d832bc1eb90d056220b69c92a4e
-size 2669692488
+oid sha256:05bee8e7c75e72dd00515b537ac0bee81b783c0640861604531167bc03e0a6e2
+size 2669692552

Dubs/v0.0.3/P_C/checkpoint-1180/README.md

@@ -1,202 +0,0 @@
----
-base_model: /content/Ai_Reboot/Dubs/v0.0.2/full_model
-library_name: peft
----
-
-# Model Card for Model ID
-
-<!-- Provide a quick summary of what the model is/does. -->
-
-
-
-## Model Details
-
-### Model Description
-
-<!-- Provide a longer summary of what this model is. -->
-
-
-
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
-
-### Model Sources [optional]
-
-<!-- Provide the basic links for the model. -->
-
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
-
-## Uses
-
-<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
-
-### Direct Use
-
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-
-[More Information Needed]
-
-### Downstream Use [optional]
-
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-
-[More Information Needed]
-
-### Out-of-Scope Use
-
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
-
-[More Information Needed]
-
-## Bias, Risks, and Limitations
-
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
-
-[More Information Needed]
-
-### Recommendations
-
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
-
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
-
-## How to Get Started with the Model
-
-Use the code below to get started with the model.
-
-[More Information Needed]
-
-## Training Details
-
-### Training Data
-
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
-
-[More Information Needed]
-
-### Training Procedure
-
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
-
-#### Preprocessing [optional]
-
-[More Information Needed]
-
-
-#### Training Hyperparameters
-
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-
-#### Speeds, Sizes, Times [optional]
-
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
-
-[More Information Needed]
-
-## Evaluation
-
-<!-- This section describes the evaluation protocols and provides the results. -->
-
-### Testing Data, Factors & Metrics
-
-#### Testing Data
-
-<!-- This should link to a Dataset Card if possible. -->
-
-[More Information Needed]
-
-#### Factors
-
-<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
-
-[More Information Needed]
-
-#### Metrics
-
-<!-- These are the evaluation metrics being used, ideally with a description of why. -->
-
-[More Information Needed]
-
-### Results
-
-[More Information Needed]
-
-#### Summary
-
-
-
-## Model Examination [optional]
-
-<!-- Relevant interpretability work for the model goes here -->
-
-[More Information Needed]
-
-## Environmental Impact
-
-<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
-
-- **Hardware Type:** [More Information Needed]
-- **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
-- **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
-
-## Technical Specifications [optional]
-
-### Model Architecture and Objective
-
-[More Information Needed]
-
-### Compute Infrastructure
-
-[More Information Needed]
-
-#### Hardware
-
-[More Information Needed]
-
-#### Software
-
-[More Information Needed]
-
-## Citation [optional]
-
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
-
-**BibTeX:**
-
-[More Information Needed]
-
-**APA:**
-
-[More Information Needed]
-
-## Glossary [optional]
-
-<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
-
-[More Information Needed]
-
-## More Information [optional]
-
-[More Information Needed]
-
-## Model Card Authors [optional]
-
-[More Information Needed]
-
-## Model Card Contact
-
-[More Information Needed]
-### Framework versions
-
-- PEFT 0.14.0

Dubs/v0.0.3/P_C/checkpoint-1180/adapter_config.json

@@ -1,32 +0,0 @@
-{
-  "alpha_pattern": {},
-  "auto_mapping": null,
-  "base_model_name_or_path": "/content/Ai_Reboot/Dubs/v0.0.2/full_model",
-  "bias": "none",
-  "eva_config": null,
-  "exclude_modules": null,
-  "fan_in_fan_out": false,
-  "inference_mode": true,
-  "init_lora_weights": true,
-  "layer_replication": null,
-  "layers_pattern": null,
-  "layers_to_transform": null,
-  "loftq_config": {},
-  "lora_alpha": 32,
-  "lora_bias": false,
-  "lora_dropout": 0.1,
-  "megatron_config": null,
-  "megatron_core": "megatron.core",
-  "modules_to_save": null,
-  "peft_type": "LORA",
-  "r": 128,
-  "rank_pattern": {},
-  "revision": null,
-  "target_modules": [
-    "self_attn.qkv_proj",
-    "self_attn.o_proj"
-  ],
-  "task_type": "CAUSAL_LM",
-  "use_dora": false,
-  "use_rslora": false
-}

Dubs/v0.0.3/P_C/checkpoint-1180/adapter_model.safetensors

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:f0d958f98ec828c030528700230daeea209514f03658f2be540c3ee1f196abe9
-size 302007584

Dubs/v0.0.3/P_C/checkpoint-1180/added_tokens.json

@@ -1,13 +0,0 @@
-{
-  "<|assistant|>": 32001,
-  "<|endoftext|>": 32000,
-  "<|end|>": 32007,
-  "<|placeholder1|>": 32002,
-  "<|placeholder2|>": 32003,
-  "<|placeholder3|>": 32004,
-  "<|placeholder4|>": 32005,
-  "<|placeholder5|>": 32008,
-  "<|placeholder6|>": 32009,
-  "<|system|>": 32006,
-  "<|user|>": 32010
-}

Dubs/v0.0.3/P_C/checkpoint-1180/optimizer.pt

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:5f57df75d294eb3f0d5e52a9bd07f57478ce60669ec59e5292d3f02d66aa12a6
-size 604059386

Dubs/v0.0.3/P_C/checkpoint-1180/rng_state.pth

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:795cf4f259dca40dc81bafec6b5275b52f053a70f70595c2783d7b8a130ee50e
-size 14244

Dubs/v0.0.3/P_C/checkpoint-1180/scheduler.pt

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:168d0a918fdd6e13ff263bac0cbb778603a9daa4e88ab22cb146177136b2e02b
-size 1064

Dubs/v0.0.3/P_C/checkpoint-1180/special_tokens_map.json

@@ -1,30 +0,0 @@
-{
-  "bos_token": {
-    "content": "<s>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "eos_token": {
-    "content": "<|endoftext|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "pad_token": {
-    "content": "<|endoftext|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "unk_token": {
-    "content": "<unk>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  }
-}

Dubs/v0.0.3/P_C/checkpoint-1180/tokenizer.model

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
-size 499723

Dubs/v0.0.3/P_C/checkpoint-1180/tokenizer_config.json

@@ -1,132 +0,0 @@
-{
-  "add_bos_token": false,
-  "add_eos_token": false,
-  "add_prefix_space": null,
-  "added_tokens_decoder": {
-    "0": {
-      "content": "<unk>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "1": {
-      "content": "<s>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "2": {
-      "content": "</s>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": false
-    },
-    "32000": {
-      "content": "<|endoftext|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "32001": {
-      "content": "<|assistant|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32002": {
-      "content": "<|placeholder1|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32003": {
-      "content": "<|placeholder2|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32004": {
-      "content": "<|placeholder3|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32005": {
-      "content": "<|placeholder4|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32006": {
-      "content": "<|system|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32007": {
-      "content": "<|end|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32008": {
-      "content": "<|placeholder5|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32009": {
-      "content": "<|placeholder6|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32010": {
-      "content": "<|user|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    }
-  },
-  "bos_token": "<s>",
-  "chat_template": "{% for message in messages %}{% if message['role'] == 'system' %}{{'<|system|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'user' %}{{'<|user|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'assistant' %}{{'<|assistant|>\n' + message['content'] + '<|end|>\n'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|assistant|>\n' }}{% else %}{{ eos_token }}{% endif %}",
-  "clean_up_tokenization_spaces": false,
-  "eos_token": "<|endoftext|>",
-  "extra_special_tokens": {},
-  "legacy": false,
-  "model_max_length": 131072,
-  "pad_token": "<|endoftext|>",
-  "padding_side": "right",
-  "sp_model_kwargs": {},
-  "tokenizer_class": "LlamaTokenizer",
-  "unk_token": "<unk>",
-  "use_default_system_prompt": false
-}

Dubs/v0.0.3/P_C/checkpoint-1180/trainer_state.json

@@ -1,362 +0,0 @@
-{
-  "best_metric": null,
-  "best_model_checkpoint": null,
-  "epoch": 1.0,
-  "eval_steps": 500,
-  "global_step": 1180,
-  "is_hyper_param_search": false,
-  "is_local_process_zero": true,
-  "is_world_process_zero": true,
-  "log_history": [
-    {
-      "epoch": 0.0211864406779661,
-      "grad_norm": 4.423079013824463,
-      "learning_rate": 3.1779661016949146e-05,
-      "loss": 13.741,
-      "step": 25
-    },
-    {
-      "epoch": 0.0423728813559322,
-      "grad_norm": 1.091511845588684,
-      "learning_rate": 6.228813559322034e-05,
-      "loss": 6.2476,
-      "step": 50
-    },
-    {
-      "epoch": 0.0635593220338983,
-      "grad_norm": 0.253110408782959,
-      "learning_rate": 9.406779661016948e-05,
-      "loss": 1.2771,
-      "step": 75
-    },
-    {
-      "epoch": 0.0847457627118644,
-      "grad_norm": 0.4360060691833496,
-      "learning_rate": 0.00012584745762711863,
-      "loss": 1.1627,
-      "step": 100
-    },
-    {
-      "epoch": 0.1059322033898305,
-      "grad_norm": 0.9220973253250122,
-      "learning_rate": 0.00014998818664978784,
-      "loss": 1.1255,
-      "step": 125
-    },
-    {
-      "epoch": 0.1271186440677966,
-      "grad_norm": 0.34438595175743103,
-      "learning_rate": 0.00014968486184124044,
-      "loss": 0.9374,
-      "step": 150
-    },
-    {
-      "epoch": 0.1483050847457627,
-      "grad_norm": 0.17265631258487701,
-      "learning_rate": 0.00014897325021132057,
-      "loss": 0.9722,
-      "step": 175
-    },
-    {
-      "epoch": 0.1694915254237288,
-      "grad_norm": 0.2722087800502777,
-      "learning_rate": 0.00014785724199485324,
-      "loss": 0.8952,
-      "step": 200
-    },
-    {
-      "epoch": 0.1906779661016949,
-      "grad_norm": 0.25106003880500793,
-      "learning_rate": 0.00014634293817985785,
-      "loss": 0.952,
-      "step": 225
-    },
-    {
-      "epoch": 0.211864406779661,
-      "grad_norm": 0.6425552368164062,
-      "learning_rate": 0.0001444386171546982,
-      "loss": 0.9457,
-      "step": 250
-    },
-    {
-      "epoch": 0.2330508474576271,
-      "grad_norm": 0.270170658826828,
-      "learning_rate": 0.00014215468945183118,
-      "loss": 0.8517,
-      "step": 275
-    },
-    {
-      "epoch": 0.2542372881355932,
-      "grad_norm": 0.5266702771186829,
-      "learning_rate": 0.00013950364083556102,
-      "loss": 0.9191,
-      "step": 300
-    },
-    {
-      "epoch": 0.2754237288135593,
-      "grad_norm": 0.16475124657154083,
-      "learning_rate": 0.00013649996404492692,
-      "loss": 1.048,
-      "step": 325
-    },
-    {
-      "epoch": 0.2966101694915254,
-      "grad_norm": 0.22005195915699005,
-      "learning_rate": 0.0001331600795648711,
-      "loss": 0.8598,
-      "step": 350
-    },
-    {
-      "epoch": 0.3177966101694915,
-      "grad_norm": 0.6684536933898926,
-      "learning_rate": 0.0001295022458588157,
-      "loss": 0.8269,
-      "step": 375
-    },
-    {
-      "epoch": 0.3389830508474576,
-      "grad_norm": 0.37612682580947876,
-      "learning_rate": 0.00012554645955338803,
-      "loss": 0.8911,
-      "step": 400
-    },
-    {
-      "epoch": 0.3601694915254237,
-      "grad_norm": 0.11635318398475647,
-      "learning_rate": 0.00012131434612096438,
-      "loss": 0.8436,
-      "step": 425
-    },
-    {
-      "epoch": 0.3813559322033898,
-      "grad_norm": 0.2107096016407013,
-      "learning_rate": 0.0001168290416576479,
-      "loss": 0.8583,
-      "step": 450
-    },
-    {
-      "epoch": 0.4025423728813559,
-      "grad_norm": 0.30154237151145935,
-      "learning_rate": 0.00011211506640297668,
-      "loss": 0.8846,
-      "step": 475
-    },
-    {
-      "epoch": 0.423728813559322,
-      "grad_norm": 0.17550069093704224,
-      "learning_rate": 0.00010719819069280337,
-      "loss": 0.8752,
-      "step": 500
-    },
-    {
-      "epoch": 0.4449152542372881,
-      "grad_norm": 0.4593244791030884,
-      "learning_rate": 0.00010210529407815477,
-      "loss": 0.8576,
-      "step": 525
-    },
-    {
-      "epoch": 0.4661016949152542,
-      "grad_norm": 0.11149267852306366,
-      "learning_rate": 9.686421838023943e-05,
-      "loss": 0.7814,
-      "step": 550
-    },
-    {
-      "epoch": 0.4872881355932203,
-      "grad_norm": 0.19643345475196838,
-      "learning_rate": 9.150361548492185e-05,
-      "loss": 0.8651,
-      "step": 575
-    },
-    {
-      "epoch": 0.5084745762711864,
-      "grad_norm": 0.29600661993026733,
-      "learning_rate": 8.605279070873881e-05,
-      "loss": 0.9697,
-      "step": 600
-    },
-    {
-      "epoch": 0.5296610169491526,
-      "grad_norm": 0.32854074239730835,
-      "learning_rate": 8.054154259274484e-05,
-      "loss": 0.7701,
-      "step": 625
-    },
-    {
-      "epoch": 0.5508474576271186,
-      "grad_norm": 1.0469460487365723,
-      "learning_rate": 7.5e-05,
-      "loss": 0.794,
-      "step": 650
-    },
-    {
-      "epoch": 0.5720338983050848,
-      "grad_norm": 0.18007223308086395,
-      "learning_rate": 6.945845740725515e-05,
-      "loss": 0.8436,
-      "step": 675
-    },
-    {
-      "epoch": 0.5932203389830508,
-      "grad_norm": 0.5170131325721741,
-      "learning_rate": 6.394720929126116e-05,
-      "loss": 0.8871,
-      "step": 700
-    },
-    {
-      "epoch": 0.614406779661017,
-      "grad_norm": 0.3806993067264557,
-      "learning_rate": 5.849638451507817e-05,
-      "loss": 0.9176,
-      "step": 725
-    },
-    {
-      "epoch": 0.635593220338983,
-      "grad_norm": 0.23310065269470215,
-      "learning_rate": 5.313578161976055e-05,
-      "loss": 0.8681,
-      "step": 750
-    },
-    {
-      "epoch": 0.6567796610169492,
-      "grad_norm": 0.4720727205276489,
-      "learning_rate": 4.789470592184522e-05,
-      "loss": 0.7799,
-      "step": 775
-    },
-    {
-      "epoch": 0.6779661016949152,
-      "grad_norm": 0.29976892471313477,
-      "learning_rate": 4.280180930719661e-05,
-      "loss": 0.7153,
-      "step": 800
-    },
-    {
-      "epoch": 0.6991525423728814,
-      "grad_norm": 0.5382867455482483,
-      "learning_rate": 3.788493359702329e-05,
-      "loss": 0.829,
-      "step": 825
-    },
-    {
-      "epoch": 0.7203389830508474,
-      "grad_norm": 0.1544274091720581,
-      "learning_rate": 3.31709583423521e-05,
-      "loss": 0.8372,
-      "step": 850
-    },
-    {
-      "epoch": 0.7415254237288136,
-      "grad_norm": 0.26499661803245544,
-      "learning_rate": 2.868565387903561e-05,
-      "loss": 0.821,
-      "step": 875
-    },
-    {
-      "epoch": 0.7627118644067796,
-      "grad_norm": 0.22001473605632782,
-      "learning_rate": 2.4453540446611943e-05,
-      "loss": 0.8232,
-      "step": 900
-    },
-    {
-      "epoch": 0.7838983050847458,
-      "grad_norm": 0.6087915897369385,
-      "learning_rate": 2.0497754141184302e-05,
-      "loss": 0.8384,
-      "step": 925
-    },
-    {
-      "epoch": 0.8050847457627118,
-      "grad_norm": 0.3740731179714203,
-      "learning_rate": 1.68399204351289e-05,
-      "loss": 0.8695,
-      "step": 950
-    },
-    {
-      "epoch": 0.826271186440678,
-      "grad_norm": 0.15192225575447083,
-      "learning_rate": 1.3500035955073088e-05,
-      "loss": 0.796,
-      "step": 975
-    },
-    {
-      "epoch": 0.847457627118644,
-      "grad_norm": 0.10293978452682495,
-      "learning_rate": 1.0496359164438988e-05,
-      "loss": 0.7925,
-      "step": 1000
-    },
-    {
-      "epoch": 0.8686440677966102,
-      "grad_norm": 0.34073716402053833,
-      "learning_rate": 7.845310548168824e-06,
-      "loss": 0.8325,
-      "step": 1025
-    },
-    {
-      "epoch": 0.8898305084745762,
-      "grad_norm": 0.2313806414604187,
-      "learning_rate": 5.561382845301771e-06,
-      "loss": 0.8819,
-      "step": 1050
-    },
-    {
-      "epoch": 0.9110169491525424,
-      "grad_norm": 0.1316712498664856,
-      "learning_rate": 3.657061820142132e-06,
-      "loss": 0.7955,
-      "step": 1075
-    },
-    {
-      "epoch": 0.9322033898305084,
-      "grad_norm": 0.1465558558702469,
-      "learning_rate": 2.142758005146761e-06,
-      "loss": 0.6769,
-      "step": 1100
-    },
-    {
-      "epoch": 0.9533898305084746,
-      "grad_norm": 0.2290423959493637,
-      "learning_rate": 1.0267497886794206e-06,
-      "loss": 0.838,
-      "step": 1125
-    },
-    {
-      "epoch": 0.9745762711864406,
-      "grad_norm": 0.15858058631420135,
-      "learning_rate": 3.1513815875957303e-07,
-      "loss": 0.8082,
-      "step": 1150
-    },
-    {
-      "epoch": 0.9957627118644068,
-      "grad_norm": 0.12132962793111801,
-      "learning_rate": 1.1813350212161455e-08,
-      "loss": 0.7888,
-      "step": 1175
-    }
-  ],
-  "logging_steps": 25,
-  "max_steps": 1180,
-  "num_input_tokens_seen": 0,
-  "num_train_epochs": 1,
-  "save_steps": 0,
-  "stateful_callbacks": {
-    "TrainerControl": {
-      "args": {
-        "should_epoch_stop": false,
-        "should_evaluate": false,
-        "should_log": false,
-        "should_save": true,
-        "should_training_stop": true
-      },
-      "attributes": {}
-    }
-  },
-  "total_flos": 5.504816495827354e+16,
-  "train_batch_size": 2,
-  "trial_name": null,
-  "trial_params": null
-}

Dubs/v0.0.3/P_C/checkpoint-1180/training_args.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:f7edcce57d73eea8bb0aac0d1a0d76f32655a89c6363b59bd3da38146264d285
-size 5624

Dubs/v0.0.3/P_C/runs/Dec15_03-01-10_a2e074eee72a/events.out.tfevents.1734232840.a2e074eee72a.11068.0

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:77cf5d4b620d7b583553b781b2edb43ab3abd38557a378e5206bd77ab11448b2
-size 874908

Dubs/v0.0.3/P_C/runs/Dec16_04-30-14_a2e074eee72a/events.out.tfevents.1734323636.a2e074eee72a.21060.1

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:46e25145604e108a49344f36e4240d5fe58e478cbba9782c7aa8e66feffeff89
-size 8733

Dubs/v0.0.3/P_C/runs/Dec16_04-39-16_a2e074eee72a/events.out.tfevents.1734323995.a2e074eee72a.23396.0

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:d875e661f09f86353b3205c966134645a0185b1e7ef42241643a3451ba2486be
-size 8940

Dubs/v0.0.3/P_C/runs/Dec16_04-41-02_a2e074eee72a/events.out.tfevents.1734324092.a2e074eee72a.23396.1

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:d98bc402128520c72fe64c2a80d5dcfe28613434e3f0ac782d976030c89ff2b7
-size 18983

Dubs/v0.0.3/P_C/runs/{Dec16_04-30-14_a2e074eee72a/events.out.tfevents.1734323590.a2e074eee72a.21060.0 → Dec16_10-32-06_a2e074eee72a/events.out.tfevents.1734345218.a2e074eee72a.92225.0}

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4c48056829ea891e573fcc5b206c6b01f327124b658e9a90fe16bcfd203c76a3
-size 8733
+oid sha256:6dcb27609442c6301b7163092cd947d1800f9daaa17c7c653e55f5521307fd98
+size 25378

Dubs/v0.0.3/adapter/README.md

@@ -1,202 +0,0 @@
----
-base_model: /content/Ai_Reboot/Dubs/v0.0.2/full_model
-library_name: peft
----
-
-# Model Card for Model ID
-
-<!-- Provide a quick summary of what the model is/does. -->
-
-
-
-## Model Details
-
-### Model Description
-
-<!-- Provide a longer summary of what this model is. -->
-
-
-
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
-
-### Model Sources [optional]
-
-<!-- Provide the basic links for the model. -->
-
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
-
-## Uses
-
-<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
-
-### Direct Use
-
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-
-[More Information Needed]
-
-### Downstream Use [optional]
-
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-
-[More Information Needed]
-
-### Out-of-Scope Use
-
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
-
-[More Information Needed]
-
-## Bias, Risks, and Limitations
-
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
-
-[More Information Needed]
-
-### Recommendations
-
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
-
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
-
-## How to Get Started with the Model
-
-Use the code below to get started with the model.
-
-[More Information Needed]
-
-## Training Details
-
-### Training Data
-
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
-
-[More Information Needed]
-
-### Training Procedure
-
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
-
-#### Preprocessing [optional]
-
-[More Information Needed]
-
-
-#### Training Hyperparameters
-
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-
-#### Speeds, Sizes, Times [optional]
-
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
-
-[More Information Needed]
-
-## Evaluation
-
-<!-- This section describes the evaluation protocols and provides the results. -->
-
-### Testing Data, Factors & Metrics
-
-#### Testing Data
-
-<!-- This should link to a Dataset Card if possible. -->
-
-[More Information Needed]
-
-#### Factors
-
-<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
-
-[More Information Needed]
-
-#### Metrics
-
-<!-- These are the evaluation metrics being used, ideally with a description of why. -->
-
-[More Information Needed]
-
-### Results
-
-[More Information Needed]
-
-#### Summary
-
-
-
-## Model Examination [optional]
-
-<!-- Relevant interpretability work for the model goes here -->
-
-[More Information Needed]
-
-## Environmental Impact
-
-<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
-
-- **Hardware Type:** [More Information Needed]
-- **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
-- **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
-
-## Technical Specifications [optional]
-
-### Model Architecture and Objective
-
-[More Information Needed]
-
-### Compute Infrastructure
-
-[More Information Needed]
-
-#### Hardware
-
-[More Information Needed]
-
-#### Software
-
-[More Information Needed]
-
-## Citation [optional]
-
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
-
-**BibTeX:**
-
-[More Information Needed]
-
-**APA:**
-
-[More Information Needed]
-
-## Glossary [optional]
-
-<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
-
-[More Information Needed]
-
-## More Information [optional]
-
-[More Information Needed]
-
-## Model Card Authors [optional]
-
-[More Information Needed]
-
-## Model Card Contact
-
-[More Information Needed]
-### Framework versions
-
-- PEFT 0.14.0

Dubs/v0.0.3/adapter/adapter_config.json

@@ -1,32 +0,0 @@
-{
-  "alpha_pattern": {},
-  "auto_mapping": null,
-  "base_model_name_or_path": "/content/Ai_Reboot/Dubs/v0.0.2/full_model",
-  "bias": "none",
-  "eva_config": null,
-  "exclude_modules": null,
-  "fan_in_fan_out": false,
-  "inference_mode": true,
-  "init_lora_weights": true,
-  "layer_replication": null,
-  "layers_pattern": null,
-  "layers_to_transform": null,
-  "loftq_config": {},
-  "lora_alpha": 32,
-  "lora_bias": false,
-  "lora_dropout": 0.1,
-  "megatron_config": null,
-  "megatron_core": "megatron.core",
-  "modules_to_save": null,
-  "peft_type": "LORA",
-  "r": 128,
-  "rank_pattern": {},
-  "revision": null,
-  "target_modules": [
-    "self_attn.qkv_proj",
-    "self_attn.o_proj"
-  ],
-  "task_type": "CAUSAL_LM",
-  "use_dora": false,
-  "use_rslora": false
-}

Dubs/v0.0.3/adapter/adapter_model.safetensors

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:f0d958f98ec828c030528700230daeea209514f03658f2be540c3ee1f196abe9
-size 302007584

Dubs/v0.0.3/adapter/added_tokens.json

@@ -1,13 +0,0 @@
-{
-  "<|assistant|>": 32001,
-  "<|endoftext|>": 32000,
-  "<|end|>": 32007,
-  "<|placeholder1|>": 32002,
-  "<|placeholder2|>": 32003,
-  "<|placeholder3|>": 32004,
-  "<|placeholder4|>": 32005,
-  "<|placeholder5|>": 32008,
-  "<|placeholder6|>": 32009,
-  "<|system|>": 32006,
-  "<|user|>": 32010
-}

Dubs/v0.0.3/adapter/special_tokens_map.json

@@ -1,30 +0,0 @@
-{
-  "bos_token": {
-    "content": "<s>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "eos_token": {
-    "content": "<|endoftext|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "pad_token": {
-    "content": "<|endoftext|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "unk_token": {
-    "content": "<unk>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  }
-}

Dubs/v0.0.3/adapter/tokenizer.model

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
-size 499723

Dubs/v0.0.3/adapter/tokenizer_config.json

@@ -1,132 +0,0 @@
-{
-  "add_bos_token": false,
-  "add_eos_token": false,
-  "add_prefix_space": null,
-  "added_tokens_decoder": {
-    "0": {
-      "content": "<unk>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "1": {
-      "content": "<s>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "2": {
-      "content": "</s>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": false
-    },
-    "32000": {
-      "content": "<|endoftext|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "32001": {
-      "content": "<|assistant|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32002": {
-      "content": "<|placeholder1|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32003": {
-      "content": "<|placeholder2|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32004": {
-      "content": "<|placeholder3|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32005": {
-      "content": "<|placeholder4|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32006": {
-      "content": "<|system|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32007": {
-      "content": "<|end|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32008": {
-      "content": "<|placeholder5|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32009": {
-      "content": "<|placeholder6|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32010": {
-      "content": "<|user|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    }
-  },
-  "bos_token": "<s>",
-  "chat_template": "{% for message in messages %}{% if message['role'] == 'system' %}{{'<|system|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'user' %}{{'<|user|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'assistant' %}{{'<|assistant|>\n' + message['content'] + '<|end|>\n'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|assistant|>\n' }}{% else %}{{ eos_token }}{% endif %}",
-  "clean_up_tokenization_spaces": false,
-  "eos_token": "<|endoftext|>",
-  "extra_special_tokens": {},
-  "legacy": false,
-  "model_max_length": 131072,
-  "pad_token": "<|endoftext|>",
-  "padding_side": "right",
-  "sp_model_kwargs": {},
-  "tokenizer_class": "LlamaTokenizer",
-  "unk_token": "<unk>",
-  "use_default_system_prompt": false
-}

Dubs/v0.0.3/full_model/added_tokens.json

@@ -1,13 +0,0 @@
-{
-  "<|assistant|>": 32001,
-  "<|endoftext|>": 32000,
-  "<|end|>": 32007,
-  "<|placeholder1|>": 32002,
-  "<|placeholder2|>": 32003,
-  "<|placeholder3|>": 32004,
-  "<|placeholder4|>": 32005,
-  "<|placeholder5|>": 32008,
-  "<|placeholder6|>": 32009,
-  "<|system|>": 32006,
-  "<|user|>": 32010
-}

Dubs/v0.0.3/full_model/config.json

@@ -1,139 +0,0 @@
-{
-  "_name_or_path": "Dubs_0.0.3",
-  "architectures": [
-    "Phi3ForCausalLM"
-  ],
-  "attention_bias": false,
-  "attention_dropout": 0.0,
-  "auto_map": {
-    "AutoConfig": "microsoft/Phi-3-mini-128k-instruct--configuration_phi3.Phi3Config",
-    "AutoModelForCausalLM": "microsoft/Phi-3-mini-128k-instruct--modeling_phi3.Phi3ForCausalLM"
-  },
-  "bos_token_id": 1,
-  "description": "Finetuned on RayBernard/leetcode, MAsad789565/Coding_GPT4_Data,abanm/preprocessed-leetcode-multi-shot",
-  "embd_pdrop": 0.0,
-  "eos_token_id": 32000,
-  "hidden_act": "silu",
-  "hidden_size": 3072,
-  "initializer_range": 0.02,
-  "intermediate_size": 8192,
-  "max_position_embeddings": 131072,
-  "model_type": "phi3",
-  "num_attention_heads": 32,
-  "num_hidden_layers": 32,
-  "num_key_value_heads": 32,
-  "original_max_position_embeddings": 4096,
-  "pad_token_id": 32000,
-  "resid_pdrop": 0.0,
-  "rms_norm_eps": 1e-05,
-  "rope_scaling": {
-    "long_factor": [
-      1.0700000524520874,
-      1.1200000047683716,
-      1.149999976158142,
-      1.4199999570846558,
-      1.5699999332427979,
-      1.7999999523162842,
-      2.129999876022339,
-      2.129999876022339,
-      3.009999990463257,
-      5.910000324249268,
-      6.950000286102295,
-      9.070000648498535,
-      9.930000305175781,
-      10.710000038146973,
-      11.130000114440918,
-      14.609999656677246,
-      15.409998893737793,
-      19.809999465942383,
-      37.279998779296875,
-      38.279998779296875,
-      38.599998474121094,
-      40.12000274658203,
-      46.20000457763672,
-      50.940006256103516,
-      53.66000747680664,
-      54.9373893737793,
-      56.89738845825195,
-      57.28738784790039,
-      59.98738479614258,
-      60.86738586425781,
-      60.887386322021484,
-      61.71739196777344,
-      62.91739273071289,
-      62.957393646240234,
-      63.41739273071289,
-      63.8173942565918,
-      63.83739471435547,
-      63.897396087646484,
-      63.93739700317383,
-      64.06739807128906,
-      64.11434936523438,
-      64.12435150146484,
-      64.15435028076172,
-      64.19435119628906,
-      64.24435424804688,
-      64.57435607910156,
-      64.69000244140625,
-      64.76000213623047
-    ],
-    "short_factor": [
-      1.1,
-      1.1,
-      1.1,
-      1.3000000000000003,
-      1.3500000000000003,
-      1.3500000000000003,
-      1.4000000000000004,
-      1.5500000000000005,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.000000000000001,
-      2.0500000000000007,
-      2.0500000000000007,
-      2.0500000000000007,
-      2.0500000000000007,
-      2.0500000000000007,
-      2.0500000000000007,
-      2.1000000000000005,
-      2.1000000000000005,
-      2.1500000000000004,
-      2.25,
-      2.25,
-      2.25,
-      2.25,
-      2.25,
-      2.3999999999999995,
-      2.4499999999999993,
-      2.499999999999999,
-      2.6999999999999984,
-      2.6999999999999984,
-      2.7499999999999982,
-      2.799999999999998,
-      2.8999999999999977,
-      3.049999999999997
-    ],
-    "type": "longrope"
-  },
-  "rope_theta": 10000.0,
-  "sliding_window": 262144,
-  "tie_word_embeddings": false,
-  "torch_dtype": "float16",
-  "transformers_version": "4.47.0",
-  "use_cache": true,
-  "vocab_size": 32064
-}

Dubs/v0.0.3/full_model/generation_config.json

@@ -1,11 +0,0 @@
-{
-  "_from_model_config": true,
-  "bos_token_id": 1,
-  "eos_token_id": [
-    32000,
-    32001,
-    32007
-  ],
-  "pad_token_id": 32000,
-  "transformers_version": "4.47.0"
-}

Dubs/v0.0.3/full_model/model-00001-of-00002.safetensors

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:878793f3d6773c165f435e36b74c2bd5111f5a340d0eadfd920236a9e897795e
-size 4972489200

Dubs/v0.0.3/full_model/model-00002-of-00002.safetensors

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:6a22d77f240871a4df9910260b8214469c33b8ecaf2a4c76efd91311abc2fb16
-size 2669692488

Dubs/v0.0.3/full_model/model.safetensors.index.json

@@ -1,202 +0,0 @@
-{
-  "metadata": {
-    "total_size": 7642159104
-  },
-  "weight_map": {
-    "lm_head.weight": "model-00002-of-00002.safetensors",
-    "model.embed_tokens.weight": "model-00001-of-00002.safetensors",
-    "model.layers.0.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.0.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.0.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.0.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.1.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.1.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.1.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.1.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.1.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.10.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.10.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.10.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.10.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.10.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.10.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.11.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.11.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.11.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.11.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.11.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.11.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.12.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.12.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.12.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.12.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.12.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.12.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.13.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.13.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.13.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.13.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.13.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.13.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.14.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.14.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.14.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.14.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.14.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.14.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.15.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.15.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.15.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.15.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.15.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.15.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.16.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.16.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.16.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.16.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.16.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.16.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.17.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.17.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.17.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.17.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.17.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.17.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.18.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.18.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.18.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.18.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.18.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.18.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.19.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.19.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.19.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.19.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.19.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.19.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.2.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.2.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.2.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.2.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.2.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.20.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.20.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.20.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.20.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.20.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.20.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.21.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.21.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.21.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.21.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.21.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.21.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.22.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.22.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.22.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.22.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.22.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.22.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.23.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.23.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.23.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.23.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.23.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.23.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.24.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.24.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.24.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.24.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.24.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.24.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.25.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.25.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.25.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.25.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.25.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.25.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.26.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.26.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.26.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.26.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.26.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.26.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.27.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.27.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.27.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.27.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.27.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.27.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.28.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.28.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.28.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.28.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.28.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.28.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.29.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.29.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.29.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.29.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.29.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.29.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.3.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.3.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.3.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.3.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.3.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.30.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.30.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.30.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.30.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.30.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.30.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.31.input_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.31.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.31.mlp.gate_up_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.31.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-    "model.layers.31.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.31.self_attn.qkv_proj.weight": "model-00002-of-00002.safetensors",
-    "model.layers.4.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.4.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.4.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.4.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.4.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.5.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.5.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.5.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.5.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.5.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.5.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.6.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.6.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.6.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.6.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.6.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.6.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.7.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.7.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.7.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.7.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.7.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.7.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.8.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.8.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.8.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.8.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.8.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.8.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.9.input_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.9.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.9.mlp.gate_up_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.9.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
-    "model.layers.9.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
-    "model.layers.9.self_attn.qkv_proj.weight": "model-00001-of-00002.safetensors",
-    "model.norm.weight": "model-00002-of-00002.safetensors"
-  }
-}

Dubs/v0.0.3/full_model/special_tokens_map.json

@@ -1,24 +0,0 @@
-{
-  "bos_token": {
-    "content": "<s>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "eos_token": {
-    "content": "<|endoftext|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "pad_token": "<|endoftext|>",
-  "unk_token": {
-    "content": "<unk>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  }
-}

Dubs/v0.0.3/full_model/tokenizer.model

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
-size 499723

Dubs/v0.0.3/full_model/tokenizer_config.json

@@ -1,132 +0,0 @@
-{
-  "add_bos_token": false,
-  "add_eos_token": false,
-  "add_prefix_space": null,
-  "added_tokens_decoder": {
-    "0": {
-      "content": "<unk>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "1": {
-      "content": "<s>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "2": {
-      "content": "</s>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": false
-    },
-    "32000": {
-      "content": "<|endoftext|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "32001": {
-      "content": "<|assistant|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32002": {
-      "content": "<|placeholder1|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32003": {
-      "content": "<|placeholder2|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32004": {
-      "content": "<|placeholder3|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32005": {
-      "content": "<|placeholder4|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32006": {
-      "content": "<|system|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32007": {
-      "content": "<|end|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32008": {
-      "content": "<|placeholder5|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32009": {
-      "content": "<|placeholder6|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    },
-    "32010": {
-      "content": "<|user|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": true,
-      "single_word": false,
-      "special": true
-    }
-  },
-  "bos_token": "<s>",
-  "chat_template": "{% for message in messages %}{% if message['role'] == 'system' %}{{'<|system|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'user' %}{{'<|user|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'assistant' %}{{'<|assistant|>\n' + message['content'] + '<|end|>\n'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|assistant|>\n' }}{% else %}{{ eos_token }}{% endif %}",
-  "clean_up_tokenization_spaces": false,
-  "eos_token": "<|endoftext|>",
-  "extra_special_tokens": {},
-  "legacy": false,
-  "model_max_length": 131072,
-  "pad_token": "<|endoftext|>",
-  "padding_side": "right",
-  "sp_model_kwargs": {},
-  "tokenizer_class": "LlamaTokenizer",
-  "unk_token": "<unk>",
-  "use_default_system_prompt": false
-}