DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Model card Files Files and versions Community

Pernekhan commited on Dec 13, 2023

Commit

03200fe

•

1 Parent(s): 6005d8a

Revert

Files changed (1) hide show

tensorrt_llm/config.pbtxt +1 -1

tensorrt_llm/config.pbtxt CHANGED Viewed

@@ -197,7 +197,7 @@ parameters: {
 parameters: {
   key: "exclude_input_in_output"
   value: {
-    string_value: "True"
   }
 }
 parameters: {

 parameters: {
   key: "exclude_input_in_output"
   value: {
+    string_value: "true"
   }
 }
 parameters: {