SwastikM
/

Meta-Llama3-8B-Chat-Instruct-LoRA

Text Generation

Function-Calling Agent

Llama-3-8B-Instruct

APIGen Function-Calling

Inference Endpoints

Model card Files Files and versions Community

SwastikM commited on Jul 23

Commit

e6a47a1

•

1 Parent(s): 47e0776

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -136,9 +136,9 @@ HuggingFace Accelerate with Training Loop.
 - **Optimizer:** AdamW
 - **lr:** 2e-5
 - **decay:** linear
-- **batch_size:** 4
-- **gradient_accumulation_steps:** 8
-- **global_step:** 625
  LoraConfig
  - ***r:*** 8

 - **Optimizer:** AdamW
 - **lr:** 2e-5
 - **decay:** linear
+- **batch_size:** 1
+- **gradient_accumulation_steps:** 2
+- **fp16:** True
  LoraConfig
  - ***r:*** 8