katie on Nostr: Yeah, I think there is a lot of growth that will be happening in the model network ...
Yeah, I think there is a lot of growth that will be happening in the model network architecture space. Using more precise smaller models for tasks that LLMs use to do specialized things, reasoning models (lots of good research going on here), as well as RI for experiments (but interestingly enough those require physics engines that we define, so most or the time they only can solve for that vs actual physics - this in combination with robotics and more sophisticated sensors though has a lot of promise - essentially self driving cars, and there is still a long ways to go there). Collaborative models are super cool though.
Ultimately though, I’m concerned about the data creation. I don’t want there to be a misunderstanding of how important it is that we continue to produce it.
Published at
2023-04-19 01:27:00Event JSON
{
"id": "4e9cafa65943b0bddd6c09d2140285a6eae7be310aedc5738eae7bc8fb5c543d",
"pubkey": "07eced8b63b883cedbd8520bdb3303bf9c2b37c2c7921ca5c59f64e0f79ad2a6",
"created_at": 1681867620,
"kind": 1,
"tags": [
[
"e",
"494bc5c6d8516f1bb712b0dcbe5a43a11724ff0f4ce44ba45fa87bd33ed8192d"
],
[
"e",
"943c254394113baa75022509cdd6cc00d8bacebbfc7fbbef11f7e22f8da72330"
],
[
"p",
"1bc70a0148b3f316da33fe3c89f23e3e71ac4ff998027ec712b905cd24f6a411"
],
[
"p",
"9baed03137d214b3e833059a93eb71cf4e5c6b3225ff7cd1057595f606088434"
]
],
"content": "Yeah, I think there is a lot of growth that will be happening in the model network architecture space. Using more precise smaller models for tasks that LLMs use to do specialized things, reasoning models (lots of good research going on here), as well as RI for experiments (but interestingly enough those require physics engines that we define, so most or the time they only can solve for that vs actual physics - this in combination with robotics and more sophisticated sensors though has a lot of promise - essentially self driving cars, and there is still a long ways to go there). Collaborative models are super cool though.\n\nUltimately though, I’m concerned about the data creation. I don’t want there to be a misunderstanding of how important it is that we continue to produce it. ",
"sig": "2df24e97aa19f22d14d3bc03a6c2089ae3ec507abc235e62d0ffc1309768fbdfeb352cb158e1834a6519ef192813eb077bda8943afe943f57860177bce5a0f33"
}