Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
DeepInfra
/
Llama-2-70b-chat-hf-trt-fp8
like
0
Follow
Deep Infra Inc.
4
License:
llama2
Model card
Files
Files and versions
Community
891ad10
Llama-2-70b-chat-hf-trt-fp8
/
tensorrt_llm
/
1
2 contributors
History:
3 commits
yessenzhar
add trtllm weights
0e96839
11 months ago
config.json
1.31 kB
add smaller files
11 months ago
llama_float16_tp4_rank0.engine
17.8 GB
LFS
add trtllm weights
11 months ago
llama_float16_tp4_rank1.engine
17.8 GB
LFS
add trtllm weights
11 months ago
llama_float16_tp4_rank2.engine
17.8 GB
LFS
add trtllm weights
11 months ago
llama_float16_tp4_rank3.engine
17.8 GB
LFS
add trtllm weights
11 months ago
model.cache
22.6 MB
LFS
add model cache
11 months ago