DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Model card Files Files and versions Community

Llama-2-70b-chat-hf-trt-fp8 / postprocessing /config.pbtxt

Commit History

update models for newer trt 0.6.1 version

dd20dba

yessenzhar commited on Dec 18, 2023

remove hardcoded weights and tokenizer dirs, replace with template

5de4d5c

yessenzhar commited on Dec 12, 2023

add smaller files

a83b588

yessenzhar commited on Dec 7, 2023