How to use this AWQ model from Python code gives an error.
#4
by
sudhir2016
- opened
How to use this AWQ model from Python code gives this error.
---> 4 import awq_inference_engine # with CUDA kernels
5
6
ImportError: libcudart.so.12: cannot open shared object file: No such file or directory