Spaces:

FSMBench
/

Leaderboard

Sleeping

App Files Files Community

taesiri commited on May 3, 2024

Commit

3b006a2

1 Parent(s): d97c883

update

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

final_df.pkl +2 -2
heatmaps/CodeLlama-70b-Instruct-hf_CoT.png +3 -0
heatmaps/CodeLlama-70b-Instruct-hf_Textonly.png +3 -0
heatmaps/Llama-2-70b-chat-hf_CoT.png +3 -0
heatmaps/Llama-2-70b-chat-hf_Textonly.png +3 -0
heatmaps/Llama-3-70b-chat-hf_CoT.png +3 -0
heatmaps/Llama-3-70b-chat-hf_Textonly.png +3 -0
heatmaps/Mistral-7B-Instruct-v0.2_CoT.png +3 -0
heatmaps/Mistral-7B-Instruct-v0.2_Textonly.png +3 -0
heatmaps/Mixtral-8x7B-Instruct-v0.1_CoT.png +3 -0
heatmaps/Mixtral-8x7B-Instruct-v0.1_Textonly.png +3 -0
heatmaps/Qwen1.5-72B-Chat_CoT.png +3 -0
heatmaps/Qwen1.5-72B-Chat_Textonly.png +3 -0
heatmaps/Yi-34B-Chat_CoT.png +3 -0
heatmaps/Yi-34B-Chat_Textonly.png +3 -0
heatmaps/claude-3-haiku-20240307_1shot.png +3 -0
heatmaps/claude-3-haiku-20240307_CoT.png +3 -0
heatmaps/claude-3-haiku-20240307_Textonly.png +3 -0
heatmaps/claude-3-haiku-20240307_vision-CoT.png +3 -0
heatmaps/claude-3-haiku-20240307_vision.png +3 -0
heatmaps/claude-3-opus-20240229_CoT.png +3 -0
heatmaps/claude-3-opus-20240229_Textonly.png +3 -0
heatmaps/claude-3-opus-20240229_vision-CoT.png +3 -0
heatmaps/claude-3-opus-20240229_vision.png +3 -0
heatmaps/claude-3-sonnet-20240229_CoT.jpg +2 -2
heatmaps/claude-3-sonnet-20240229_CoT.png +3 -0
heatmaps/claude-3-sonnet-20240229_Textonly.png +3 -0
heatmaps/claude-3-sonnet-20240229_vision-CoT.png +3 -0
heatmaps/claude-3-sonnet-20240229_vision.jpg +2 -2
heatmaps/claude-3-sonnet-20240229_vision.png +3 -0
heatmaps/dbrx-instruct_CoT.png +3 -0
heatmaps/dbrx-instruct_Textonly.png +3 -0
heatmaps/deepseek-llm-67b-chat_CoT.png +3 -0
heatmaps/deepseek-llm-67b-chat_Textonly.png +3 -0
heatmaps/gemini-pro-vision_vision-CoT.jpg +3 -0
heatmaps/gemini-pro-vision_vision-CoT.png +3 -0
heatmaps/gemini-pro-vision_vision.jpg +3 -0
heatmaps/gemini-pro-vision_vision.png +3 -0
heatmaps/gemini-pro_CoT.png +3 -0
heatmaps/gemini-pro_vision-CoT.png +3 -0
heatmaps/gemini-pro_vision.png +3 -0
heatmaps/gemma-7b-it_CoT.png +3 -0
heatmaps/gemma-7b-it_Textonly.png +3 -0
heatmaps/gpt-3.5-0613_CoT.png +3 -0
heatmaps/gpt-3.5-0613_Textonly.png +3 -0
heatmaps/gpt-3.5-turbo-0125_1shot.png +3 -0
heatmaps/gpt-3.5-turbo-0125_CoT.png +3 -0
heatmaps/gpt-3.5-turbo-0125_Textonly.png +3 -0
heatmaps/gpt-35-turbo_1shot.jpg +3 -0
heatmaps/gpt-35-turbo_1shot.png +3 -0

final_df.pkl CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7b9acd5d65e88a0cc6655be4987086354db2719122a843652e75ba9b5d7b7d7d
-size 797916821

 version https://git-lfs.github.com/spec/v1
+oid sha256:af070cfe995dc7525d87a670f0cb915085ba643ddc23b68e535ffbf9f5d5b4cf
+size 812473008

heatmaps/CodeLlama-70b-Instruct-hf_CoT.png ADDED Viewed

Git LFS Details

SHA256: d4b703d3999364930556cf371142a5bba2110b71783cb88fa8909ae85d714671
Pointer size: 132 Bytes
Size of remote file: 1.02 MB

heatmaps/CodeLlama-70b-Instruct-hf_Textonly.png ADDED Viewed

Git LFS Details

SHA256: 1c6ae2fb07adadc075d0aed53c8844721b6adbaf8fd0a7778846c7462907d8a9
Pointer size: 132 Bytes
Size of remote file: 1.02 MB

heatmaps/Llama-2-70b-chat-hf_CoT.png ADDED Viewed

Git LFS Details

SHA256: f17dd315ca49a7edbb33f1644a9a9e4c7e65d07d1d2e04071c13794e9b2c78c0
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/Llama-2-70b-chat-hf_Textonly.png ADDED Viewed

Git LFS Details

SHA256: 8377077937b29b87238695c35315c51f31c588b210b39fdd582dfad45dbeec1c
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/Llama-3-70b-chat-hf_CoT.png ADDED Viewed

Git LFS Details

SHA256: ac8d589c5c452688ef8b64a8c97853537cf4c022835536900216a66dbd69f437
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/Llama-3-70b-chat-hf_Textonly.png ADDED Viewed

Git LFS Details

SHA256: 18e2f11ebe5236c6b08725e6b900ab625136c644719d44179c5ab3411e1565ab
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/Mistral-7B-Instruct-v0.2_CoT.png ADDED Viewed

Git LFS Details

SHA256: 5c4d747f70b2678115568f1f5d0b9508da6ad176c624505d3ea627fb0e15d3a3
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/Mistral-7B-Instruct-v0.2_Textonly.png ADDED Viewed

Git LFS Details

SHA256: 6139f6cbefafdc34b27b58bfd8ce67285166e08363a9d00fcc6a92bffb7943fa
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/Mixtral-8x7B-Instruct-v0.1_CoT.png ADDED Viewed

Git LFS Details

SHA256: 53390f5c4a574f3900d4f574545b67acdeae2850085be202e52b0e44ab8a641d
Pointer size: 132 Bytes
Size of remote file: 1.02 MB

heatmaps/Mixtral-8x7B-Instruct-v0.1_Textonly.png ADDED Viewed

Git LFS Details

SHA256: cd489ef12cf2536223105023772f86b43f0d1a2082821a8ee8f650a2f3b11e2c
Pointer size: 132 Bytes
Size of remote file: 1.02 MB

heatmaps/Qwen1.5-72B-Chat_CoT.png ADDED Viewed

Git LFS Details

SHA256: ba485c5af43d1ada5c5aec35135d4412732ccf1b61042307b43bc9fc7de3bb63
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/Qwen1.5-72B-Chat_Textonly.png ADDED Viewed

Git LFS Details

SHA256: da6a75456ce2f11d7adda03ab3741d0a4965f23562baf96e0455bd3e6c837fbf
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/Yi-34B-Chat_CoT.png ADDED Viewed

Git LFS Details

SHA256: b0203cef5e3bd69355f8c6b77c769378dacb3ff6fe518ce162d15ee98b74980f
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/Yi-34B-Chat_Textonly.png ADDED Viewed

Git LFS Details

SHA256: f1cfa52dc642befaf19311d03498bb53e4d7e633b9c8f15e5819b83502fa74ba
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-haiku-20240307_1shot.png ADDED Viewed

Git LFS Details

SHA256: ac10f7119f60f0b7fbcc3596fb5e0fc531918e3aaad13efd16b378f5531b6a99
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-haiku-20240307_CoT.png ADDED Viewed

Git LFS Details

SHA256: 58718d439e2b2f3ca2cdf6077fe52c02697171bee292c57d5c0e69c172b558d8
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-haiku-20240307_Textonly.png ADDED Viewed

Git LFS Details

SHA256: 1ce63eae77b0bee6126753b0b4dd92e875606c85a2e9053be79a48ea5f3710a9
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-haiku-20240307_vision-CoT.png ADDED Viewed

Git LFS Details

SHA256: 881eb2164cab4b6c725df5876dbb6ac308b27df0aab9cb168e8146af05f7dfe7
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-haiku-20240307_vision.png ADDED Viewed

Git LFS Details

SHA256: a7999d05af83274310ab0c5a2bc8c35f55cfbe11741214d92c1540e836b902a8
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-opus-20240229_CoT.png ADDED Viewed

Git LFS Details

SHA256: 97b1aa99bd7f3314c5edcd40ad9c8372f249967818bce03c7fb2d35709ce749e
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-opus-20240229_Textonly.png ADDED Viewed

Git LFS Details

SHA256: afacabca17ef01693140c10014c9bac2be4429511c93bd690f13c135f88565d1
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-opus-20240229_vision-CoT.png ADDED Viewed

Git LFS Details

SHA256: 189329927bf4a5238920c94af0a8981afdd8bcd5ccdc17328a5bb766b391fd5e
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-opus-20240229_vision.png ADDED Viewed

Git LFS Details

SHA256: 1ba0697318c6fe5883b116386c867b45a4e38ad770e3f4250caa57bfa95ceb09
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-sonnet-20240229_CoT.jpg CHANGED Viewed

Git LFS Details

SHA256: 97f3fcc436adf32351392db6fe0b36969554ecfef9f5a6be87d6cb73b59d3840
Pointer size: 132 Bytes
Size of remote file: 1.33 MB

Git LFS Details

SHA256: ea55e964a1547d4462364c8f41ecbaf870af6cb151589bc45af03bbcc171afad
Pointer size: 132 Bytes
Size of remote file: 1.28 MB

heatmaps/claude-3-sonnet-20240229_CoT.png ADDED Viewed

Git LFS Details

SHA256: 8bb80b9223b84284c4b7b00b43fc352bc083e472cc153252a46f67885ce74c9e
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-sonnet-20240229_Textonly.png ADDED Viewed

Git LFS Details

SHA256: 5bd38f277f8ab03ff4394b563a72634ddaf7a39044561e25a1b1d9c734695f2d
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-sonnet-20240229_vision-CoT.png ADDED Viewed

Git LFS Details

SHA256: 2a93035f2d36505bb6c6126b541704bb42cc6c3a4aff47b76e79f4221ba9b3c7
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/claude-3-sonnet-20240229_vision.jpg CHANGED Viewed

Git LFS Details

SHA256: ea55e964a1547d4462364c8f41ecbaf870af6cb151589bc45af03bbcc171afad
Pointer size: 132 Bytes
Size of remote file: 1.28 MB

Git LFS Details

SHA256: 97f3fcc436adf32351392db6fe0b36969554ecfef9f5a6be87d6cb73b59d3840
Pointer size: 132 Bytes
Size of remote file: 1.33 MB

heatmaps/claude-3-sonnet-20240229_vision.png ADDED Viewed

Git LFS Details

SHA256: 85b53bb356b419260d72c5a1ab4c5c095c759fc3bed9f6023ad9703577211d16
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/dbrx-instruct_CoT.png ADDED Viewed

Git LFS Details

SHA256: 0ece339a94f8ffc03a5ddb611e0ef9ebd43716f55bcdfbc1ee72dee3db092c9b
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/dbrx-instruct_Textonly.png ADDED Viewed

Git LFS Details

SHA256: e1b49a0957e72d26093d87055ed1d3547ec5b15cdbea16fc152bce108dd0a089
Pointer size: 132 Bytes
Size of remote file: 1.02 MB

heatmaps/deepseek-llm-67b-chat_CoT.png ADDED Viewed

Git LFS Details

SHA256: f0019a7d6d2ee430c5f7385da3d7670ca4093714d8adc5efda5e85f1d82abd1e
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/deepseek-llm-67b-chat_Textonly.png ADDED Viewed

Git LFS Details

SHA256: 13d0ed905e772cd6bac1313c4b2be38b8c94b6805c1619038f2ded2fb1d8c6eb
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gemini-pro-vision_vision-CoT.jpg ADDED Viewed

Git LFS Details

SHA256: 116b2a07fb740560e59471347f4c6da6fbb251ef0a6cda7f4c3cd9cf8ef2beac
Pointer size: 132 Bytes
Size of remote file: 1.33 MB

heatmaps/gemini-pro-vision_vision-CoT.png ADDED Viewed

Git LFS Details

SHA256: 760d125e5041c0ab84740df1cc1aaa201e4e7b6cdc1957e20be2cdb5642fe969
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gemini-pro-vision_vision.jpg ADDED Viewed

Git LFS Details

SHA256: 36cc139756d58b144d03cffdd23df7a07a71f1a3b77d8544b35d24afbece3a10
Pointer size: 132 Bytes
Size of remote file: 1.33 MB

heatmaps/gemini-pro-vision_vision.png ADDED Viewed

Git LFS Details

SHA256: ad0d9194c4035d8ce57f7ee9ea4807dc4169349576f1eecc56def274a16cc69a
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gemini-pro_CoT.png ADDED Viewed

Git LFS Details

SHA256: 4277a0cd9c8d3289a79c89ff36ffd983e103f781a66879c2dbe136eb08823133
Pointer size: 132 Bytes
Size of remote file: 1.02 MB

heatmaps/gemini-pro_vision-CoT.png ADDED Viewed

Git LFS Details

SHA256: 760d125e5041c0ab84740df1cc1aaa201e4e7b6cdc1957e20be2cdb5642fe969
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gemini-pro_vision.png ADDED Viewed

Git LFS Details

SHA256: ad0d9194c4035d8ce57f7ee9ea4807dc4169349576f1eecc56def274a16cc69a
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gemma-7b-it_CoT.png ADDED Viewed

Git LFS Details

SHA256: e8f6d3816f1f9de91e83f3d5d918f59e8498c1ff3b4bf6c67da776c08cafe72c
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gemma-7b-it_Textonly.png ADDED Viewed

Git LFS Details

SHA256: b201026783da62603536971932d37effbdf59151545c82def24af8ab23718678
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gpt-3.5-0613_CoT.png ADDED Viewed

Git LFS Details

SHA256: 0f7384d2c201299c3eb1a7fdf82a4430f62a5f5730dbf63aa9bd5f5d878ef0b3
Pointer size: 132 Bytes
Size of remote file: 1.02 MB

heatmaps/gpt-3.5-0613_Textonly.png ADDED Viewed

Git LFS Details

SHA256: 0fb1964c888537286beeec01612bd66b620b1c0c94f31b6ad84e54c52475b97a
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gpt-3.5-turbo-0125_1shot.png ADDED Viewed

Git LFS Details

SHA256: ee8bb855f9aeb66f2c695c11cb7b3da4ecae44c4c5f3ac5ef70bc47edf78644b
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gpt-3.5-turbo-0125_CoT.png ADDED Viewed

Git LFS Details

SHA256: c282cd460ba6186cc8eaf7835a34d494a7d7071f9b189033ba2688014d9a55a2
Pointer size: 132 Bytes
Size of remote file: 1.02 MB

heatmaps/gpt-3.5-turbo-0125_Textonly.png ADDED Viewed

Git LFS Details

SHA256: acee80e0cbdb9cd65e8b9dd6798e095006df1899ab5de48ec4b7f1698cce5392
Pointer size: 132 Bytes
Size of remote file: 1.01 MB

heatmaps/gpt-35-turbo_1shot.jpg ADDED Viewed

Git LFS Details

SHA256: 45770b4c8e836e17cccb2ad73ed7894802f070fbfb760c166881a9ada6eccaa5
Pointer size: 132 Bytes
Size of remote file: 1.32 MB

heatmaps/gpt-35-turbo_1shot.png ADDED Viewed

Git LFS Details

SHA256: ee8bb855f9aeb66f2c695c11cb7b3da4ecae44c4c5f3ac5ef70bc47edf78644b
Pointer size: 132 Bytes
Size of remote file: 1.01 MB