Depressing and simultaneously a reflection of our zeitgeist:
If you don't have history/algo recommendation turned on youtube and search for "mechanisms of attention" or "attention mechanisms", you get pages and pages of videos on attention in transformers/deep-nets in AI. Just "attention" includes a lot of songs/music videos along with explanation on transformers. You squint a bit as you scroll, you might miss the very few videos on attention in psychology and/or neuroscience.
It's as if the most relevant and meaningful idea/usage for the vast majority of people is meant to be difficult to access and learn about.
#Attention
Karthik Srinivasan /
npub160…76fkd
2023-09-01 23:17:03
Author Public Key
npub160cfnc8ucrqhs3n85wtnhvje5v6sms4jtj0jeg9ltqxgq3meuftq776fkdPublished at
2023-09-01 23:17:03Event JSON
{
"id": "5a341ee7e5beb511ba7bdf402baece97ee81542f5e42e4cba69e9dcb450d0bac",
"pubkey": "d3f099e0fcc0c1784667a3973bb259a3350dc2b25c9f2ca0bf580c804779e256",
"created_at": 1693610223,
"kind": 1,
"tags": [
[
"t",
"attention"
],
[
"proxy",
"https://neuromatch.social/users/skarthik/statuses/110992439590022737",
"activitypub"
]
],
"content": "Depressing and simultaneously a reflection of our zeitgeist: \n\nIf you don't have history/algo recommendation turned on youtube and search for \"mechanisms of attention\" or \"attention mechanisms\", you get pages and pages of videos on attention in transformers/deep-nets in AI. Just \"attention\" includes a lot of songs/music videos along with explanation on transformers. You squint a bit as you scroll, you might miss the very few videos on attention in psychology and/or neuroscience. \n\nIt's as if the most relevant and meaningful idea/usage for the vast majority of people is meant to be difficult to access and learn about.\n\n#Attention",
"sig": "0583177c439d551f0a74c2e580134ade2862bbaa8082c2736523b248ce16c9019b19bb0ec0b1d14ca2d01d95cf4309b9ff1e0af9428a268cb7635a4d06a320a4"
}