Skip to content

Commit

Permalink
Update
Browse files Browse the repository at this point in the history
  • Loading branch information
oobabooga committed Apr 24, 2024
1 parent 90a4360 commit 2963e4b
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions benchmark.html
Original file line number Diff line number Diff line change
Expand Up @@ -111,6 +111,7 @@ <h1 class="title">oobabooga benchmark</h1>
<tr><td>22/48</td><td>wizardlm-70b-v1.0.Q4_K_M-HF</td><td>70B</td><td>llamacpp_HF</td><td></td></tr>
<tr><td>22/48</td><td>turboderp_command-r-v01-35B-exl2_6.0bpw</td><td>35B</td><td>ExLlamav2_HF</td><td></td></tr>
<tr><td>22/48</td><td>tulu-2-dpo-70b.Q4_K_M-HF</td><td>70B</td><td>llamacpp_HF</td><td></td></tr>
<tr><td>22/48</td><td>meraGPT_mera-mix-4x7B</td><td>4x7B</td><td>Transformers</td><td></td></tr>
<tr><td>22/48</td><td>liuhaotian_llava-v1.5-13b</td><td>13B</td><td>Transformers</td><td></td></tr>
<tr><td>22/48</td><td>Qwen_Qwen1.5-7B-Chat</td><td>7B</td><td>Transformers</td><td></td></tr>
<tr><td>22/48</td><td>Meta-Llama-3-8B-Instruct-Q4_K_S-HF</td><td>8B</td><td>llamacpp_HF</td><td></td></tr>
Expand All @@ -136,6 +137,7 @@ <h1 class="title">oobabooga benchmark</h1>
<tr><td>19/48</td><td>Meta-Llama-3-8B-Instruct-IQ3_S-HF</td><td>8B</td><td>llamacpp_HF</td><td><a href="https://huggingface.co/bartowski/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-IQ3_S.gguf">[link]</a></td></tr>
<tr><td>18/48</td><td>mistralai_Mistral-7B-Instruct-v0.2</td><td>7B</td><td>Transformers</td><td></td></tr>
<tr><td>18/48</td><td>Qwen_Qwen1.5-MoE-A2.7B-Chat</td><td>14.3B</td><td>Transformers</td><td></td></tr>
<tr><td>18/48</td><td>Orenguteng_Lexi-Llama-3-8B-Uncensored</td><td>8B</td><td>Transformers</td><td></td></tr>
<tr><td>18/48</td><td>Meta-Llama-3-8B-Instruct-Q3_K_M-HF</td><td>8B</td><td>llamacpp_HF</td><td></td></tr>
<tr><td>18/48</td><td>Meta-Llama-3-8B-Instruct-Q3_K_L-HF</td><td>8B</td><td>llamacpp_HF</td><td></td></tr>
<tr><td>18/48</td><td>Meta-Llama-3-70B-Instruct-IQ1_M-HF</td><td>70B</td><td>llamacpp_HF</td><td></td></tr>
Expand Down Expand Up @@ -194,6 +196,8 @@ <h3>2024/04/23</h3>
<ul>
<li><b style="color: blue">microsoft_Phi-3-mini-128k-instruct</b> (3.8B) - 19/48</li>
<li><b style="color: blue">microsoft_Phi-3-mini-4k-instruct</b> (3.8B) - 23/48</li>
<li><b style="color: blue">meraGPT_mera-mix-4x7B</b> (4x7B) - 22/48</li>
<li><b style="color: blue">Orenguteng_Lexi-Llama-3-8B-Uncensored</b> (8B) - 18/48</li>
</ul>
<h2>About</h2>
<p>This test consists of 48 manually written multiple-choice questions. It evaluates a combination of academic knowledge and logical reasoning.</p>
Expand Down

0 comments on commit 2963e4b

Please sign in to comment.