Want an LLM to run locally on your laptop?
Go follow npub1f6a33pfyp67y8llhunlhrf855xm47n3fdqymvxfj7yx78c6vqf4scxpnql (npub1f6a…pnql)'s instructions on download's Mozilla's "llamafile"
I just did, and it's quite remarkable
Granted, I'm running it on a speedy new M2 mac, but the performance is amazing
https://simonwillison.net/2023/Nov/29/llamafile/
Clive Thompson /
npub1d2…hpnye
2023-12-03 16:34:09
Author Public Key
npub1d2uhcqzxevd07dj92ja2854uadgy888fx4et524a9gf4ltuzhw8qkhpnyePublished at
2023-12-03 16:34:09Event JSON
{
"id": "e41a93db845da2880bd58ec952f10b0d95aa93de4da6f61048d1a3efb26dd819",
"pubkey": "6ab97c0046cb1aff364554baa3d2bceb50439ce93572ba2abd2a135faf82bb8e",
"created_at": 1701621249,
"kind": 1,
"tags": [
[
"p",
"4ebb1885240ebc43fff7e4ff71a4f4a1b75f4e296809b61932f10de3e34c026b",
"wss://relay.mostr.pub"
],
[
"p",
"8b0be93ed69c30e9a68159fd384fd8308ce4bbf16c39e840e0803dcb6c08720e",
"wss://relay.mostr.pub"
],
[
"proxy",
"https://saturation.social/users/clive/statuses/111517450184475234",
"activitypub"
]
],
"content": "Want an LLM to run locally on your laptop?\n\nGo follow nostr:npub1f6a33pfyp67y8llhunlhrf855xm47n3fdqymvxfj7yx78c6vqf4scxpnql's instructions on download's Mozilla's \"llamafile\"\n\nI just did, and it's quite remarkable\n\nGranted, I'm running it on a speedy new M2 mac, but the performance is amazing\n\nhttps://simonwillison.net/2023/Nov/29/llamafile/",
"sig": "4ce8b50c5e14d152a29a23265f5dd36652566bc426a5cc516313ab79a8a7e8442959cc880fa23039c428811804ee00b38c3148fd15238f2bcefee95a3dcc14c6"
}