Fascinating. I'm so out of my depth. How does this article square with the one a few months back (with one of those two authors) ? : https://www.semianalysis.com/p/google-we-have-no-moat-and-neither
"Leaked Internal Google Document Claims Open Source AI Will Outcompete Google and OpenAI"
"While our models still hold a slight edge in terms of quality, the gap is closing astonishingly quickly. Open-source models are faster, more customizable, more private, and pound-for-pound more capable. They are doing things with $100 and 13B params that we struggle with at $10M and 540B. And they are doing so in weeks, not months. This has profound implications for us:We have no secret sauce. Our
best hope is to learn from and collaborate with what others are doing
outside Google. We should prioritize enabling 3P integrations.People will not pay for a restricted model when free, unrestricted alternatives are comparable in quality. We should consider where our value add really is.Giant models are slowing us down. In the long run, the best models are the ones which
can be iterated upon quickly. We should make small variants more than
an afterthought, now that we know what is possible in the <20B
parameter regime."
WonteetZebugs / Wonteet Zebugs
npub1ug…nxyvc
2023-08-28 15:50:19
in reply to nevent1q…5dq3
Author Public Key
npub1ugtcn9u9qj8wzhdxd2cugcemseuazs0fd3fxq974u7cej889sjusynxyvcPublished at
2023-08-28 15:50:19Event JSON
{
"id": "86ba1270b44cdbe83c8840c1c0a0b2f56e71033e166a549906ab80d65443086d",
"pubkey": "e217899785048ee15da66ab1c4633b8679d141e96c526017d5e7b1991ce584b9",
"created_at": 1693237819,
"kind": 1,
"tags": [
[
"p",
"82341f882b6eabcd2ba7f1ef90aad961cf074af15b9ef44a09f9d2a8fbfbe6a2",
"wss://relay.damus.io",
"jack"
],
[
"e",
"84ecf68a8319648739d28608881710755e61d7422ffd2f4c7474fa3d407d667c",
"wss://relay.damus.io",
"root"
],
[
"client",
"coracle"
]
],
"content": "Fascinating. I'm so out of my depth. How does this article square with the one a few months back (with one of those two authors) ? : https://www.semianalysis.com/p/google-we-have-no-moat-and-neither\n\n\"Leaked Internal Google Document Claims Open Source AI Will Outcompete Google and OpenAI\"\n\n\"While our models still hold a slight edge in terms of quality, the gap is closing astonishingly quickly. Open-source models are faster, more customizable, more private, and pound-for-pound more capable. They are doing things with $100 and 13B params that we struggle with at $10M and 540B. And they are doing so in weeks, not months. This has profound implications for us:We have no secret sauce. Our\n best hope is to learn from and collaborate with what others are doing \noutside Google. We should prioritize enabling 3P integrations.People will not pay for a restricted model when free, unrestricted alternatives are comparable in quality. We should consider where our value add really is.Giant models are slowing us down. In the long run, the best models are the ones which\n can be iterated upon quickly. We should make small variants more than \nan afterthought, now that we know what is possible in the \u003c20B \nparameter regime.\"",
"sig": "2afb20cac06a88725f6c17f3727183d9db7dd96e5b38df32eb6a7f01d46e7ca042e4c5fbf0ec82fe7a56af277c76cdd9bd6713f40c874290de5ba7d8b49a4337"
}