Spaces:
Running
Running
| model,throughput,response_length,latency,energy | |
| BAIR/koala-13b,20.727175709016876,254.08025520483545,11.892537351481359,2191.190301544663 | |
| BAIR/koala-7b,25.954660733201525,259.2263263935527,9.768064146371243,1447.61525218268 | |
| BlinkDL/RWKV-4-Raven-7B-v12-Eng98%-Other2%-20230521-ctx8192.pth,61.486296272233105,244.58898589657488,3.6864172847628747,892.832628945603 | |
| FreedomIntelligence/phoenix-inst-chat-7b,55.22014703563219,221.38582941571525,3.8385676472189307,887.4773411685698 | |
| Neutralzz/BiLLa-7B-SFT,32.311906190353724,146.99966420416388,4.4437706789731255,750.0805171255877 | |
| OpenAssistant/oasst-sft-1-pythia-12b,24.935530057384018,250.45466756212224,9.786432366627167,2029.4657938213645 | |
| StabilityAI/stablelm-tuned-alpha-7b,45.08986296277073,232.79348556077903,4.994290238837428,1132.5013462055056 | |
| camel-ai/CAMEL-13B-Combined-Data,26.545864806820514,244.7578912021491,9.198450972152804,2025.3281155137665 | |
| databricks/dolly-v2-12b,22.230280077272955,161.52820685023505,8.256380503504923,1374.5864308260586 | |
| h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,32.73570790682367,219.56077904633983,6.708469191383511,1011.1683317662861 | |
| lmsys/fastchat-t5-3b-v1.0,33.043489972767865,355.22464741437204,15.602670499951651,1307.8302488247155 | |
| lmsys/vicuna-13B,21.00930585347828,266.4140362659503,12.326653083850998,2284.892455003353 | |
| lmsys/vicuna-7B,26.456122167045812,269.8492276695769,9.998248218763614,1393.5497108797765 | |
| metaai/llama-13B,22.701925773082262,99.55339153794493,3.953801921461699,853.2385591000668 | |
| metaai/llama-7B,29.32171747886574,107.48018804566823,3.322338972945185,561.9730688381476 | |
| nomic-ai/gpt4all-13b-snoozy,25.875636961002073,219.97582269979853,8.453523028629553,1718.9753918737365 | |
| openaccess-ai-collective/manticore-13b-chat-pyg,26.222449633250086,275.88179986568167,10.469822985415593,2115.522391537931 | |
| project-baize/baize-v2-7B,32.41073358811793,300.9086635325722,9.142081563219637,1529.693656480853 | |
| tatsu-lab/alpaca-7B,25.79378618278183,127.34217595701813,4.787391331217622,727.924358965749 | |
| togethercomputer/RedPajama-INCITE-7B-Chat,27.400950213545173,283.26158495634655,9.932342660383254,1629.655866689063 | |