Compiled engines for running Whisper with TRT LLM for much faster inference.
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten
company
Verified
AI & ML interests
None defined yet.
Recent Activity
View all activity
Collections
1
models
669
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-TinyLlama-1.1B-Chat-v1.0-NVIDIA-H100-80GB-HBM3-v0.16.0-TP1-lookahead
Updated
•
2
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-TinyLlama-1.1B-Chat-v1.0-NVIDIA-H100-80GB-HBM3-v0.16.0-TP1
Updated
•
11
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/r1-nextn-heads
Updated
•
31
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/whisper_trt_large_v3_turbo_NVIDIA_A10G_0_13_0
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/whisper_trt_large_v3_NVIDIA_L4_0_13_0_20250210
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/whisper_trt_large_v3_test_decoder_NVIDIA_H100_80GB_HBM3_0_13_0
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-Qwen2.5-Coder-7B-NVIDIA-H100-80GB-HBM3-v0.16.0-TP4-FP8
Updated
•
10
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-Qwen2.5-Coder-7B-NVIDIA-H100-80GB-HBM3-v0.16.0-TP4
Updated
•
19
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-Qwen2.5-Coder-7B-NVIDIA-H100-80GB-HBM3-v0.16.0-TP1
Updated
•
7
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/RandomQwen2ForSequenceClassification-0.5B
Text Classification
•
Updated
•
545