Jeff Geerling on Nostr: My Raspberry Pi 5 runs GPU-accelerated LLMs ('AI') using Vulkan and llama.cpp, using ...
Published at
2024-11-19 21:30:48Event JSON
{
"id": "7e40225e36d0b56bbea446d8af2992a22eaec647bd1377548e856bb3a5f768b9",
"pubkey": "051acee30009506ea470900693ec6746dc740e9f61e43c95fc909556539edc78",
"created_at": 1732051848,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.social/users/geerlingguy/statuses/113511749967822393",
"activitypub"
]
],
"content": "My Raspberry Pi 5 runs GPU-accelerated LLMs ('AI') using Vulkan and llama.cpp, using external AMD graphics cards.\n\nFull story: https://www.youtube.com/watch?v=AyR7iCS7gNI",
"sig": "e10a5e990b5f522a3ca621d53344a78e7043bab19e256af93ff190b0565d912c3264143ec75bdfff62dfc45cb48be593de560b742a7fc7e088ea4eee331b12cc"
}
