yunginter.net on Nostr: Thanks for pointing me toward ollama i have the 64gb to run a larger model on ...
Thanks for pointing me toward ollama i have the 64gb to run a larger model on desktop, gonna try out this weekend. Nice model browser they have.
also been playing with mlc chat on my phone… haven’t pushed that past 7b either.
Published at
2024-02-02 22:27:55Event JSON
{
"id": "7a866094b0d8c443c45edd4ec85e69e998503baf3574cec2f66b10a94148b795",
"pubkey": "5fd693e61a7969ecf5c11dbf5ce20aedac1cea71721755b037955994bf6061bb",
"created_at": 1706912875,
"kind": 1,
"tags": [
[
"e",
"3b87c8ed4cbbe559e74b9f04e7a95e86de82967fa0809b0a78284137c6186c72"
],
[
"e",
"46373b3a4942a00e33fc8238c9b767e2f1e3571857a1cd8660e8f909c36d7bfc"
],
[
"p",
"7d50ca8c167a10723c24afa9fe9ac7170dc4d5c000d7fcd470c5aecf7ff3aeb7"
],
[
"p",
"7d50ca8c167a10723c24afa9fe9ac7170dc4d5c000d7fcd470c5aecf7ff3aeb7"
]
],
"content": "Thanks for pointing me toward ollama i have the 64gb to run a larger model on desktop, gonna try out this weekend. Nice model browser they have.\n\nalso been playing with mlc chat on my phone… haven’t pushed that past 7b either.",
"sig": "24eb15fa4b9236f6e2d560e146ff188adc7a54f5ff7896c7577d2e430149723add967de7ca001915d960542c3fa92e71b89deaffaee5333cb126b73143f05e65"
}
