The 70b version of #llama3 weighs in at 39 GB. Yikes.
May exercise the laptop #GPU on this one.
I'm already wondering if it's worth it. Llama3 has been charmingly stupid - the literal accomplice to writing that asks pretty dumb questions. đ
I find that useful, for some reason. Likely because I can ignore it. đ đ
Taran Rampersad /
npub1j3âŚj55x2
2024-05-29 13:42:28
in reply to nevent1qâŚm2sl
Author Public Key
npub1j33kuu9hrg2ukwtnnpyy4hgs70hhlvl5pf3vgv9l68y8spe8cdxqsj55x2Seen on
wss://relay.nostr.bandPublished at
2024-05-29 13:42:28Event JSON
{
"id": "b15e767ea00854a74a123afe474e947a6d1419d987474727c113dca207597a8f",
"pubkey": "94636e70b71a15cb397398484add10f3ef7fb3f40a62c430bfd1c8780727c34c",
"created_at": 1716990148,
"kind": 1,
"tags": [
[
"t",
"llama3"
],
[
"e",
"cdb58994e00f2bd226bc14ba2e593d83def43de5b6f2c37286f5037cc7256a36",
"",
"root"
],
[
"t",
"gpu"
],
[
"p",
"94636e70b71a15cb397398484add10f3ef7fb3f40a62c430bfd1c8780727c34c"
],
[
"proxy",
"https://mastodon.social/@knowprose/112524666352688627",
"web"
],
[
"proxy",
"https://mastodon.social/users/knowprose/statuses/112524666352688627",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mastodon.social/users/knowprose/statuses/112524666352688627",
"pink.momostr"
]
],
"content": "The 70b version of #llama3 weighs in at 39 GB. Yikes. \n\nMay exercise the laptop #GPU on this one. \n\nI'm already wondering if it's worth it. Llama3 has been charmingly stupid - the literal accomplice to writing that asks pretty dumb questions. đ \n\nI find that useful, for some reason. Likely because I can ignore it. đ đ",
"sig": "26fec282285272c1a2c48627da4bd48a10c272b7c6f143e192804bb593176396ee9338c24a5346008c4340a1ed9b7a14e83d3180cd138746d90ec09dc11cc37f"
}