TechPostsFromX on Nostr: Are there good tools to make benchmark testing easy? I’m trying to test with MMAU ...
Are there good tools to make benchmark testing easy? I’m trying to test with MMAU but kinda wish it was easier than copy/pasting the GitHub and getting ChatGPT to build a script for me.
It’s taking a lot of back and forths, needing to grab sample data from huggingface, reviewing output of script to make sure it’s formatted correctly, etc…
Source: x.com/yoheinakajima/status/1848058566571393105
Published at
2024-10-20 20:18:28Event JSON
{
"id": "073d9057713df5923ca2ab5d718b3a93ae3de2e6251c99a752b5319d4bfed292",
"pubkey": "52d119f46298a8f7b08183b96d4e7ab54d6df0853303ad4a3c3941020f286129",
"created_at": 1729455508,
"kind": 1,
"tags": [],
"content": "Are there good tools to make benchmark testing easy? I’m trying to test with MMAU but kinda wish it was easier than copy/pasting the GitHub and getting ChatGPT to build a script for me.\n\nIt’s taking a lot of back and forths, needing to grab sample data from huggingface, reviewing output of script to make sure it’s formatted correctly, etc…\nhttps://image.nostr.build/fa8c4d79daed51e5f8288599922506e021d1a6b0d065ad5faca67e208f87afe2.png\n\nSource: x.com/yoheinakajima/status/1848058566571393105",
"sig": "4445f56fc11500eb79605b7c97bb5ed6482138e1658a331a868bc88eb3242493439910bb1b7b0b85ee9de7721921aa5f87d406d2ffa267a3b44649fd307eab86"
}