runtime error

h is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn(f'for {key}: copying from a non-meta parameter in the checkpoint to a meta ' /home/user/.local/lib/python3.10/site-packages/torch/nn/modules/module.py:2025: UserWarning: for base_model.model.transformer.h.31.self_attention.query_key_value.lora_A.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn(f'for {key}: copying from a non-meta parameter in the checkpoint to a meta ' /home/user/.local/lib/python3.10/site-packages/torch/nn/modules/module.py:2025: UserWarning: for base_model.model.transformer.h.31.self_attention.query_key_value.lora_B.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn(f'for {key}: copying from a non-meta parameter in the checkpoint to a meta ' Traceback (most recent call last): File "/home/user/app/app.py", line 47, in <module> model = PeftModel.from_pretrained(model, PEFT_MODEL) File "/home/user/.local/lib/python3.10/site-packages/peft/peft_model.py", line 352, in from_pretrained model.load_adapter(model_id, adapter_name, is_trainable=is_trainable, **kwargs) File "/home/user/.local/lib/python3.10/site-packages/peft/peft_model.py", line 722, in load_adapter dispatch_model( File "/home/user/.local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 438, in dispatch_model raise ValueError( ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.

Container logs: