someone on Nostr: Mistral Small 3.1 numbers are in. It is interesting Mistral always lands in the ...
Mistral Small 3.1 numbers are in. It is interesting Mistral always lands in the middle.
https://sheet.zoho.com/sheet/open/mz41j09cc640a29ba47729fed784a263c1d08?sheetid=0&range=A1I started to do the comparison with 2 models now. In the past Llama 3.1 70B Q4 was the one doing the comparison of answers. Now I am using Gemma 3 27B Q8 as well to have a second opinion on it. Gemma 3 produces very similar measurement to Llama 3.1. So the end result is not going to shake much.
Published at
2025-03-24 19:38:58Event JSON
{
"id": "161f39c9068e676611a95437e08ebfafb161b93b8ece6e31012764f54d1e7818",
"pubkey": "9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1",
"created_at": 1742845138,
"kind": 1,
"tags": [
[
"client",
"Yakihonne",
"31990:20986fb83e775d96d188ca5c9df10ce6d613e0eb7e5768a0f0b12b37cdac21b3:1700732875747"
]
],
"content": "Mistral Small 3.1 numbers are in. It is interesting Mistral always lands in the middle.\nhttps://sheet.zoho.com/sheet/open/mz41j09cc640a29ba47729fed784a263c1d08?sheetid=0\u0026range=A1\n\nI started to do the comparison with 2 models now. In the past Llama 3.1 70B Q4 was the one doing the comparison of answers. Now I am using Gemma 3 27B Q8 as well to have a second opinion on it. Gemma 3 produces very similar measurement to Llama 3.1. So the end result is not going to shake much.\n\n https://image.nostr.build/dc6d170b3601e3af004fa8d302260ff4476aa8b409f05dffa33bedaf3beb1c16.jpg",
"sig": "2f51d0059131b1b94d03447e89841784bf6848f03ad312aedd52b0a81d0813f32c3c1544c6ed9fe9f9e64de1c46ac655b76c568a638d61dc09e3ab19528a4a24"
}
