runtime error
Exit code: 1. Reason: 774kB/s] Some parameters are on the meta device because they were offloaded to the disk and cpu. Loading adapter from alaamostafa/Microsoft-Phi-2... adapter_config.json: 0%| | 0.00/771 [00:00<?, ?B/s][A adapter_config.json: 100%|██████████| 771/771 [00:00<00:00, 4.98MB/s] Could not load bitsandbytes native library: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.32' not found (required by /usr/local/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bitsandbytes/cextension.py", line 85, in <module> lib = get_native_library() File "/usr/local/lib/python3.10/site-packages/bitsandbytes/cextension.py", line 72, in get_native_library dll = ct.cdll.LoadLibrary(str(binary_path)) File "/usr/local/lib/python3.10/ctypes/__init__.py", line 452, in LoadLibrary return self._dlltype(name) File "/usr/local/lib/python3.10/ctypes/__init__.py", line 374, in __init__ self._handle = _dlopen(self._name, mode) OSError: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.32' not found (required by /usr/local/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so) adapter_model.safetensors: 0%| | 0.00/62.9M [00:00<?, ?B/s][A adapter_model.safetensors: 100%|█████████▉| 62.9M/62.9M [00:00<00:00, 97.0MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 29, in <module> model = PeftModel.from_pretrained( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 581, in from_pretrained load_result = model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1290, in load_adapter self._update_offload(offload_index, adapters_weights) File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1121, in _update_offload safe_module = dict(self.named_modules())[extended_prefix] KeyError: 'base_model.model.model.model.embed_tokens'
Container logs:
Fetching error logs...