|
[2024-07-15 14:24:23,419] [INFO] [real_accelerator.py:191:get_accelerator] Setting ds_accelerator to cuda (auto detect) |
|
07/15/2024 14:24:25 - INFO - llmtuner.data.template - Add <|im_end|>,<|endoftext|> to stop words. |
|
07/15/2024 14:24:25 - INFO - llmtuner.model.patcher - Using KV cache for faster generation. |
|
07/15/2024 14:24:27 - INFO - llmtuner.model.adapter - Fine-tuning method: LoRA |
|
07/15/2024 14:24:38 - INFO - llmtuner.model.adapter - Merged 1 adapter(s). |
|
07/15/2024 14:24:38 - INFO - llmtuner.model.adapter - Loaded adapter(s): /ML-A100/team/mm/eamon/self_instruction/seed_ppl/qwen14B_models/qwen_14B_d2_iter3_model |
|
07/15/2024 14:24:38 - INFO - llmtuner.model.loader - all params: 14167290880 |
|
|