Simon Willison on Nostr: I pulled together notes on all of the LLM plugins that have worked for me for Llama 3 ...
I pulled together notes on all of the LLM plugins that have worked for me for Llama 3 - both for hosting locally (I've run 8B and 70B on my 64GB M2) and access via APIs (Groq is SO FAST for that)
{
"id":"3d8680fca44b675d016a6a5af415815deeb706c065ec3e1d4958dbf7cb1a8f5d",
"pubkey":"8b0be93ed69c30e9a68159fd384fd8308ce4bbf16c39e840e0803dcb6c08720e",
"created_at":1713793506,
"kind":1,
"tags": [
[
"proxy",
"https://fedi.simonwillison.net/users/simon/statuses/112315171266092901",
"activitypub"
]
],
"content":"I pulled together notes on all of the LLM plugins that have worked for me for Llama 3 - both for hosting locally (I've run 8B and 70B on my 64GB M2) and access via APIs (Groq is SO FAST for that)\n\nOptions for accessing Llama 3 from the terminal using LLM\nhttps://simonwillison.net/2024/Apr/22/llama-3/\n\nhttps://cdn.masto.host/fedisimonwillisonnet/media_attachments/files/112/315/170/806/722/956/original/81f8c519fe112560.mp4",
"sig":"ab770bd10514f149f8ff8c8b1f3bbc3d981bec4d11c8b23e6574271bbbe85e8b1bb347c65d94cdbe766393926d0f16ded443f192cfa3ff025739c82d29dd6843"
}
