abhinavkulkarni
/

mosaicml-mpt-30b-instruct-w4-g128-awq

Text Generation

text-generation-inference

Model card Files Files and versions Community

Abhinav Kulkarni commited on Sep 12, 2023

Commit

5009189

•

1 Parent(s): 4d3e251

Updated README

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -32,7 +32,7 @@ For Docker users, the `nvcr.io/nvidia/pytorch:23.06-py3` image is runtime v12.1
 ```bash
 git clone https://github.com/mit-han-lab/llm-awq \
 && cd llm-awq \
-&& git checkout ce4a6bb1c238c014a06672cb74f6865573494d66 \
 && pip install -e . \
 && cd awq/kernels \
 && python setup.py install

 ```bash
 git clone https://github.com/mit-han-lab/llm-awq \
 && cd llm-awq \
+&& git checkout f084f40bd996f3cf3a0633c1ad7d9d476c318aaa \
 && pip install -e . \
 && cd awq/kernels \
 && python setup.py install