Simon Willison on Nostr: Here's the super-short version. For a ~4GB local model that should run on most ...
Here's the super-short version. For a ~4GB local model that should run on most laptops:
```
brew install llm # or pipx install llm
llm install llm-gpt4all
llm -m Meta-Llama-3-8B-Instruct "Three great names for a pet emu"
```
This will download the model file the first time you call it, but it will be cached and reused for subsequent prompts
Published at
2024-04-22 15:43:10Event JSON
{
"id": "b518db7199d9d9195306c16e2900e88251deb0748bc97ff8a0cc76502104853c",
"pubkey": "8b0be93ed69c30e9a68159fd384fd8308ce4bbf16c39e840e0803dcb6c08720e",
"created_at": 1713800590,
"kind": 1,
"tags": [
[
"e",
"3d8680fca44b675d016a6a5af415815deeb706c065ec3e1d4958dbf7cb1a8f5d",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://fedi.simonwillison.net/users/simon/statuses/112315635485592033",
"activitypub"
]
],
"content": "Here's the super-short version. For a ~4GB local model that should run on most laptops:\n```\nbrew install llm # or pipx install llm\nllm install llm-gpt4all\nllm -m Meta-Llama-3-8B-Instruct \"Three great names for a pet emu\"\n```\nThis will download the model file the first time you call it, but it will be cached and reused for subsequent prompts",
"sig": "a611e94adf13eb6d2a252061015a31a60b84e816672093204a19e401c603a538154b740d34bdc3793dfad244718b1aea5c8933e3ad8d2c9a80c260ddff6dc0cf"
}