yes that is supported, but the local models just aren't as good right now. it seems they are rapidly improving with new consumer hardware though.
in the meantime, https://jb55.com/lmzap and not including any identifiable information in the prompt will help a lot.
jb55 /
npub1xt…vkk5s
2025-05-02 01:51:01
in reply to nevent1q…g8h6
Author Public Key
npub1xtscya34g58tk0z605fvr788k263gsu6cy9x0mhnm87echrgufzsevkk5sPublished at
2025-05-02 01:51:01Event JSON
{
"id": "26122b510ce4604f9477cdb5ae52be8ae6d87e7713697e98fdafc0ce18c54ebb",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1746150661,
"kind": 1,
"tags": [
[
"client",
"Damus Notedeck"
],
[
"e",
"dff7e4367e89bb80aba3c41b6d60eca064a4efdc253aaa9d76aa39803c8afb4c",
"",
"root"
],
[
"e",
"215cff4628a0179dc208e5e109c22c2074c9fe5614afeaa2f39d38428aba3d19",
"",
"reply"
],
[
"p",
"94182adc7a1571ff6b0da3db8f219bb4187645ec00f7bed94bac27b732a5e706"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
]
],
"content": "yes that is supported, but the local models just aren't as good right now. it seems they are rapidly improving with new consumer hardware though.\n\nin the meantime, https://jb55.com/lmzap and not including any identifiable information in the prompt will help a lot.",
"sig": "df2fbefcb3d56aff51a62ee1521252e514f078ece6d368f78d97570cf39360677dced98ad5f43a695ff64d7f18a065ce413cb1809a66fa8b55d12150a4c34abe"
}