Fuggy 🇮🇱✡️ on Nostr: Electric Pants :prince_dance: UhhhElon Sues OpenAI claiming their not open People ...
Electric Pants :prince_dance: (npub1qq7…fedr) UhhhElon Sues OpenAI claiming their not open
People call Elon out for not having his models as open source (Grok)
He says he will open source it in a week
Everyone expects it to be 33B because on the website it said it was model based on Grok-0 which is 33B parameters
Does
Code is complete garbage and pretty much useless
Code depends on having 8 GPUs even if you can run it on less
Turns out It's 300B MoE model based on experts fine tuned from Grok-0
Barley beats GPT-3 (175B)
No one can run it because of that
The weights are int8 instead of fp16 so that throws wrench in everything like fine tuning etc. Pretty sure
Be me
Open issue about releasing Grok-0 weights which would be 33B in theory
It gets closed as not planned
Literally no explanation
Imb4 they just stop developing the related code just like they did with the "open source algorithm" and literally every other open source project under Twitter/X/x.ai GitHub org
I ask them for at least explanation as to why they can't release Grok-0 weights
They reopen the issue without explanation as wellHuffing hopium for now for Grok-0 but I still feel like it's virtue signal for their court case with OpenAI, I doubt they will release any other models after this
Published at
2024-03-18 22:27:16Event JSON
{
"id": "ed3db27d4e1cdce2fd3c26404d9bdc72a8d9860dfda9b0e83d2b66de42039f37",
"pubkey": "ca8fa66e08b6f54d5441e7b8d5913c8f5aee4f47b8d7bece99733bcd223ec227",
"created_at": 1710800836,
"kind": 1,
"tags": [
[
"p",
"003d7fd21fd09ff7f6f63a75daf194dd99feefbe6919cc376b7359d5090aa9a6",
"wss://relay.mostr.pub"
],
[
"e",
"26d928a25e9eefe9693ce2b4fd0630a06ccd47f265cb6c9c680b7e54781aab15",
"wss://relay.mostr.pub",
"reply"
],
[
"emoji",
"top_kek",
"https://skippers-bin.com/files/011473ae-925a-433b-b675-2696b6238fb7"
],
[
"emoji",
"pepe_lol",
"https://skippers-bin.com/files/06ee7ab3-cf6b-4454-b1dd-3aab8c5c712c"
],
[
"proxy",
"https://skippers-bin.com/notes/9r12yj45je",
"activitypub"
]
],
"content": "nostr:npub1qq7hl5sl6z0l0ahk8f6a4uv5mkvlama7dyvucdmtwdva2zg24xnqyafedr \n\nUhhhElon Sues OpenAI claiming their not open\nPeople call Elon out for not having his models as open source (Grok)\nHe says he will open source it in a week\nEveryone expects it to be 33B because on the website it said it was model based on Grok-0 which is 33B parameters \nDoes\nCode is complete garbage and pretty much useless\nCode depends on having 8 GPUs even if you can run it on less :top_kek:\nTurns out It's 300B MoE model based on experts fine tuned from Grok-0\nBarley beats GPT-3 (175B) :pepe_lol:\nNo one can run it because of that\nThe weights are int8 instead of fp16 so that throws wrench in everything like fine tuning etc. Pretty sure\nBe me\nOpen issue about releasing Grok-0 weights which would be 33B in theory\nIt gets closed as not planned\nLiterally no explanation\nImb4 they just stop developing the related code just like they did with the \"open source algorithm\" and literally every other open source project under Twitter/X/x.ai GitHub org\nI ask them for at least explanation as to why they can't release Grok-0 weights\nThey reopen the issue without explanation as wellHuffing hopium for now for Grok-0 but I still feel like it's virtue signal for their court case with OpenAI, I doubt they will release any other models after this",
"sig": "909c2fd9d7b1541872fcd58582f7f05122f3236b8229f5fff328d93a37db69b4a9df30b5f40a21f738f2068866c3bf903212c1832d6e7d14a61d5488b02a6512"
}