Update README.md

README.md

@@ -2,16 +2,30 @@
 library_name: transformers
 tags:
 - unsloth
+- information-extraction
+- llama3
+- finetuning
+language:
+- en
 ---
 
 # Model Card for Model ID
 
-<!-- Provide a quick summary of what the model is/does. -->
+The model extracts the triplet from the given text.
+Example:
+Input: "Nie Haisheng, born on October 13, 1964, worked as a fighter pilot."
+Output: {'mtriple_set': [['Nie_Haisheng | birthDate | 1964-10-13',
+   'Nie_Haisheng | occupation | Fighter_pilot']]}
 
 
 
 ## Model Details
 
+Base Model: Llama 3 - 8B
+Qunatisation: 4 bit
+LoRA rank: 16
+
+
 ### Model Description
 
 <!-- Provide a longer summary of what this model is. -->
@@ -93,8 +107,33 @@ Use the code below to get started with the model.
 
 #### Training Hyperparameters
 
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-
+- **Training regime:**
+
+max_seq_length = 2000
+trainer = SFTTrainer(
+    model = model,
+    tokenizer = tokenizer,
+    train_dataset = train,
+    dataset_text_field = "text",
+    max_seq_length = max_seq_length,
+    dataset_num_proc = 2,
+    packing = False, # Can make training 5x faster for short sequences.
+    args = TrainingArguments(
+        per_device_train_batch_size = 2,
+        gradient_accumulation_steps = 4,
+        warmup_steps = 5,
+        max_steps = 50,
+        learning_rate = 2e-4,
+        fp16 = not is_bfloat16_supported(),
+        bf16 = is_bfloat16_supported(),
+        logging_steps = 1,
+        optim = "adamw_8bit",
+        weight_decay = 0.01,
+        lr_scheduler_type = "linear",
+        seed = 3407,
+        output_dir = "outputs",
+    ),
+)
 #### Speeds, Sizes, Times [optional]
 
 <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
@@ -145,9 +184,9 @@ Use the code below to get started with the model.
 
 Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
 
-- **Hardware Type:** [More Information Needed]
+- **Hardware Type:** 1 T4 GPU, RAM: 16 GB
 - **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
+- **Cloud Provider:** Google CoLab
 - **Compute Region:** [More Information Needed]
 - **Carbon Emitted:** [More Information Needed]
 
@@ -171,7 +210,7 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
 
 ## Citation [optional]
 
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+https://colab.research.google.com/drive/135ced7oHytdxu3N2DNe1Z0kqjyYIkDXp?usp=sharing#scrollTo=kR3gIAX-SM2q
 
 **BibTeX:**