mleku on Nostr: i think that they are optimizing for data size and compute time and more depth of ...
i think that they are optimizing for data size and compute time and more depth of causal chains means exponentially bigger models are required
probably you can make it work but you have to allow for 10-100x as much data in the model and about the same difference in computation, and my guess is that renders the efficiency gain null
and i don't think it's gonna be that much different in C, Rust or C++, they are all very strongly typed and have deep semantics with side effects that you don't see with the little scripts of javascript and python code
Published at
2025-04-01 08:57:15Event JSON
{
"id": "c70d4fb8eca7b9446e75b3ae491df79f0f2d1006a4cc53972589f8b5464bd70c",
"pubkey": "4c800257a588a82849d049817c2bdaad984b25a45ad9f6dad66e47d3b47e3b2f",
"created_at": 1743497835,
"kind": 1,
"tags": [
[
"e",
"9271d58d6f4a55baf651c06f39dfa920c35c299b5d355c205b032ff3f6f0b209",
"wss://theforest.nostr1.com/",
"root",
"fd208ee8c8f283780a9552896e4823cc9dc6bfd442063889577106940fd927c1"
],
[
"e",
"be14f5c894dc6484e9e0163f4e6e9b04903d01e931dd681ecbbd63233dfaac26",
"wss://theforest.nostr1.com/",
"reply",
"fd208ee8c8f283780a9552896e4823cc9dc6bfd442063889577106940fd927c1"
],
[
"p",
"7cc328a08ddb2afdf9f9be77beff4c83489ff979721827d628a542f32a247c0e"
],
[
"p",
"fd208ee8c8f283780a9552896e4823cc9dc6bfd442063889577106940fd927c1"
],
[
"client",
"jumble"
]
],
"content": "i think that they are optimizing for data size and compute time and more depth of causal chains means exponentially bigger models are required\n\nprobably you can make it work but you have to allow for 10-100x as much data in the model and about the same difference in computation, and my guess is that renders the efficiency gain null\n\nand i don't think it's gonna be that much different in C, Rust or C++, they are all very strongly typed and have deep semantics with side effects that you don't see with the little scripts of javascript and python code",
"sig": "11004ecd53b6e6e4f90daf7073a8dc9ecfbe5c6ebd0bcc97f2eec395f8e103431115e97a5ca8960e063803f39ea84ff7e100513955764d72778232f4996c8149"
}