DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Model card Files Files and versions Community

Llama-2-70b-chat-hf-trt-fp8 / tensorrt_llm /1

2 contributors

History: 5 commits

yessenzhar's picture

update models for newer trt 0.6.1 version

dd20dba 11 months ago

config.json

1.57 kB

update models for newer trt 0.6.1 version 11 months ago
llama_float16_tp4_rank0.engine

17.8 GB
LFS

add weights compiled by 0.6.1 trtllm 11 months ago
llama_float16_tp4_rank1.engine

17.8 GB
LFS

add weights compiled by 0.6.1 trtllm 11 months ago
llama_float16_tp4_rank2.engine

17.8 GB
LFS

add weights compiled by 0.6.1 trtllm 11 months ago
llama_float16_tp4_rank3.engine

17.8 GB
LFS

add weights compiled by 0.6.1 trtllm 11 months ago
model.cache

13.8 MB
LFS

add weights compiled by 0.6.1 trtllm 11 months ago