Now that "scale is all we need" has predictably faltered...
1. Small AI models often perform better in context.
2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture.
Me +
nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpq4m5nu28anh99cmxqymavktvahtzexknxstgtgedfqk9dv0r3sh3sx5c5h6 (nprofile…c5h6)
@sashaluccioni
arxiv.org/abs/2409.14160
Meredith Whittaker /
npub15s…z6r6y
2024-11-17 12:30:48
Author Public Key
npub15s3hussvmv9nyvw3w8lg0x72udazmdat7tcj5vmmjafnwcvv8tpqzz6r6yPublished at
2024-11-17 12:30:48Event JSON
{
"id": "16001d3e00b9b63b7f5d31895d971eb033a0124ae420d1ceb6ecfadefe769853",
"pubkey": "a4237e420cdb0b3231d171fe879bcae37a2db7abf2f12a337b975337618c3ac2",
"created_at": 1731846648,
"kind": 1,
"tags": [
[
"p",
"aee93e28fd9dca5c6cc026facb2d9dbac5935a6682d0b465a9058ad63c7185e3",
"wss://relay.mostr.pub"
],
[
"p",
"9523aa53471cd8f3f4a477108f39ef1bb1834c09b36768ba96bdb6ab2774fee7",
"wss://relay.mostr.pub"
],
[
"proxy",
"https://mastodon.world/users/Mer__edith/statuses/113498301954115142",
"activitypub"
]
],
"content": "Now that \"scale is all we need\" has predictably faltered...\n\n1. Small AI models often perform better in context.\n\n2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture.\n\nMe + \nnostr:nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpq4m5nu28anh99cmxqymavktvahtzexknxstgtgedfqk9dv0r3sh3sx5c5h6 \n@sashaluccioni\n \n\narxiv.org/abs/2409.14160",
"sig": "52f44146a37977c9fc695116df2a0357f46b0695f7adbf0a3eecb1fa8dfa26238420630409a863dccbb3d18026519429e0f65f44383481acd33adc8ae1db8d9a"
}