Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
oobabooga committed Apr 27, 2024
1 parent 14988f8 commit 0ca050c
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion benchmark.html
Original file line number Diff line number Diff line change
Expand Up @@ -79,6 +79,7 @@ <h1 class="title">oobabooga benchmark</h1>
<tr><td>34/48</td><td>Meta-Llama-3-70B-Instruct-Q4_K_S</td><td>70B</td><td>llamacpp_HF</td><td><a href="https://huggingface.co/bartowski/Meta-Llama-3-70B-Instruct-GGUF/">[link]</a></td></tr>
<tr><td>33/48</td><td>turboderp_Llama-3-70B-Instruct-exl2_6.0bpw</td><td>70B</td><td>ExLlamav2_HF</td><td></td></tr>
<tr><td>33/48</td><td>turboderp_Llama-3-70B-Instruct-exl2_5.0bpw</td><td>70B</td><td>ExLlamav2_HF</td><td></td></tr>
<tr><td>33/48</td><td>Undi95_Meta-Llama-3-70B-Instruct-hf</td><td>70B</td><td>Transformers</td><td>--load-in-4bit</td></tr>
<tr><td>33/48</td><td>Meta-Llama-3-70B-Instruct.Q8_0</td><td>70B</td><td>llamacpp_HF</td><td></td></tr>
<tr><td>33/48</td><td>Meta-Llama-3-70B-Instruct.Q4_K_M</td><td>70B</td><td>llamacpp_HF</td><td></td></tr>
<tr><td>33/48</td><td>Meta-Llama-3-70B-Instruct-Q3_K_S</td><td>70B</td><td>llamacpp_HF</td><td><a href="https://huggingface.co/bartowski/Meta-Llama-3-70B-Instruct-GGUF/">[link]</a></td></tr>
Expand Down Expand Up @@ -230,7 +231,10 @@ <h1 class="title">oobabooga benchmark</h1>
</table>
<div class="comments">
<h2>Updates</h2>
<h3>2024/04/26</h3>
<h3>2024/04/27</h3>
<ul>
<li><b style="color: blue">Undi95_Meta-Llama-3-70B-Instruct-hf</b> (70B) - 33/48</li>
</ul><h3>2024/04/26</h3>
<ul>
<li><b style="color: blue">Weyaxi_Einstein-v6.1-Llama3-8B</b> (8B) - 20/48</li>
<li><b style="color: blue">Qwen1.5-110B-Chat-Q4_K_M</b> (110B) - 29/48</li>
Expand Down

0 comments on commit 0ca050c

Please sign in to comment.