runtime error
Exit code: 1. Reason: ra_B.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn(f'for {key}: copying from a non-meta parameter in the checkpoint to a meta ' /usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py:2068: UserWarning: for base_model.model.model.layers.27.mlp.down_proj.lora_A.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn(f'for {key}: copying from a non-meta parameter in the checkpoint to a meta ' /usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py:2068: UserWarning: for base_model.model.model.layers.27.mlp.down_proj.lora_B.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn(f'for {key}: copying from a non-meta parameter in the checkpoint to a meta ' Traceback (most recent call last): File "/home/user/app/app.py", line 13, in <module> model = PeftModel.from_pretrained(model, model_path) File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 545, in from_pretrained model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1151, in load_adapter self._update_offload(offload_index, adapters_weights) File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1028, in _update_offload safe_module = dict(self.named_modules())[extended_prefix] KeyError: 'base_model.model.model.model.embed_tokens'
Container logs:
Fetching error logs...