И I K O L A S (He/Him) on Nostr: It does work on rpi4 4GB but it is hallucinating.. Really interesting dev tho #llm ...
It does work on rpi4 4GB but it is hallucinating.. Really interesting dev tho https://github.com/microsoft/BitNet #llm #1bit
И I K O L A S (He/Him) /
npub15m…7nfn2
2024-11-22 06:01:09
Author Public Key
npub15m0retfl0ufex2cnrpznq8h9ckql23g406u9rqk3n9jjnvzm8ygqs7nfn2Published at
2024-11-22 06:01:09Event JSON
{
"id": "f03abd3f62be80d250711e15de22263c22a4008f307a81823e95db8395a51ed2",
"pubkey": "a6de3cad3f7f13932b131845301ee5c581f545157eb85182d1996529b05b3910",
"created_at": 1732255269,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"1bit"
],
[
"imeta",
"url https://files.mastodon.social/media_attachments/files/113/525/079/838/695/576/original/04bb5a073842c7c3.png",
"m image/png",
"dim 970x792",
"blurhash U-Jb28o#D%s.00adxuWDIUWCt6oe-pkCRkax"
],
[
"proxy",
"https://mastodon.social/users/silentexception/statuses/113525081364250820",
"activitypub"
]
],
"content": "It does work on rpi4 4GB but it is hallucinating.. Really interesting dev tho https://github.com/microsoft/BitNet #llm #1bit\n\nhttps://files.mastodon.social/media_attachments/files/113/525/079/838/695/576/original/04bb5a073842c7c3.png",
"sig": "bae022679f81a2e995fb2cf9db7e6520fb6a8c2fc1cec17638870ec90606dcfc044ed19dcfc6ec17f7682a19172f8b68cd6490dab731ebe28e948a95175b8b4c"
}