npub10l88929ze7h5h7g7pu7y0e0077c03zqtp9zk63zpx4gg7m2ypcnq8eath2 (npub10l8…ath2) - but I didn't say "neural networks research is physics". I say "it all started with physics", and gave evidence for how Hopfield and Hinton were using ideas from statistical mechanics. Yes, neural network research has grown beyond this now - it's now its own subject. I don't think anyone is claiming otherwise.
Wikipedia on Hopfield networks:
"The Sherrington–Kirkpatrick model of spin glass, published in 1975, is the Hopfield network with random initialization. Sherrington and Kirkpatrick found that it is highly likely for the energy function of the SK model to have many local minima. In the 1982 paper, Hopfield applied this recently developed theory to study the Hopfield network with binary activation functions. In a 1984 paper he extended this to continuous activation functions. It became a standard model for the study of neural networks through statistical mechanics."
Wikipedia on Boltzmann machines:
"They are named after the Boltzmann distribution in statistical mechanics, which is used in their sampling function. They were heavily popularized and promoted by Geoffrey Hinton, Terry Sejnowski and Yann LeCun in cognitive sciences communities, particularly in machine learning, as part of "energy-based models" (EBM), because Hamiltonians of spin glasses as energy are used as a starting point to define the learning task."
John Carlos Baez /
npub17u…8pd6m
2024-10-08 22:52:57
in reply to nevent1q…rw85
Author Public Key
npub17u6xav5rjq4d48fpcyy6j05rz2xelp7clnl8ptvpnval9tvmectqp8pd6mSeen on
wss://relay.mostr.pubPublished at
2024-10-08 22:52:57Event JSON
{
"id": "35c1170d73988e2cf6f44abd46721ff8289c2e25a7cd93b5c25abb8b201bf5a6",
"pubkey": "f7346eb283902ada9d21c109a93e83128d9f87d8fcfe70ad819b3bf2ad9bce16",
"created_at": 1728427977,
"kind": 1,
"tags": [
[
"p",
"7fce72a8a2cfaf4bf91e0f3c47e5eff7b0f8880b09456d444135508f6d440e26",
"wss://relay.mostr.pub"
],
[
"p",
"f44c5df3773df373cda9861fe92904fb9662d1ec25385c94fe8bed045577fb82",
"wss://relay.mostr.pub"
],
[
"e",
"afcc6c0db9c7f90f869add4a9a20b1b4918d162931b349d5860356d9161f2f01",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://mathstodon.xyz/users/johncarlosbaez/statuses/113274255965090383",
"activitypub"
]
],
"content": "nostr:npub10l88929ze7h5h7g7pu7y0e0077c03zqtp9zk63zpx4gg7m2ypcnq8eath2 - but I didn't say \"neural networks research is physics\". I say \"it all started with physics\", and gave evidence for how Hopfield and Hinton were using ideas from statistical mechanics. Yes, neural network research has grown beyond this now - it's now its own subject. I don't think anyone is claiming otherwise.\n\nWikipedia on Hopfield networks:\n\n\"The Sherrington–Kirkpatrick model of spin glass, published in 1975, is the Hopfield network with random initialization. Sherrington and Kirkpatrick found that it is highly likely for the energy function of the SK model to have many local minima. In the 1982 paper, Hopfield applied this recently developed theory to study the Hopfield network with binary activation functions. In a 1984 paper he extended this to continuous activation functions. It became a standard model for the study of neural networks through statistical mechanics.\"\n\nWikipedia on Boltzmann machines:\n\n\"They are named after the Boltzmann distribution in statistical mechanics, which is used in their sampling function. They were heavily popularized and promoted by Geoffrey Hinton, Terry Sejnowski and Yann LeCun in cognitive sciences communities, particularly in machine learning, as part of \"energy-based models\" (EBM), because Hamiltonians of spin glasses as energy are used as a starting point to define the learning task.\"",
"sig": "29491548224ec9488b5e2cf6b1fc292228497b4ba3525787b7eb725ee0f4563878cbd5756d2410ca88698049f43dd5da87a44bf546880bd361757c54eb2327b6"
}