Simon Willison on Nostr: Or if you want to try Llama 3 70B at maximum speed via an API using Get an API key ...
Or if you want to try Llama 3 70B at maximum speed via an API using
https://groq.com/ Get an API key from
https://console.groq.com/keysThen run this:
```
llm install 'https:''//github.com/lexh/llm-groq/archive/ba9d7de74b3057b074a85fe99fe873b75519bd78.zip'
llm keys set groq
# <paste API key here>
llm -m groq-llama3-70b 'a bad poem about a hungry pelican'
```
Published at
2024-04-22 15:44:54Event JSON
{
"id": "e5db206d27ac02313834e64786094e2199879dc5c948d32411aeb2664fab366c",
"pubkey": "8b0be93ed69c30e9a68159fd384fd8308ce4bbf16c39e840e0803dcb6c08720e",
"created_at": 1713800694,
"kind": 1,
"tags": [
[
"e",
"b518db7199d9d9195306c16e2900e88251deb0748bc97ff8a0cc76502104853c",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://fedi.simonwillison.net/users/simon/statuses/112315642311843259",
"activitypub"
]
],
"content": "Or if you want to try Llama 3 70B at maximum speed via an API using https://groq.com/ \n\nGet an API key from https://console.groq.com/keys\n\nThen run this:\n```\nllm install 'https:''//github.com/lexh/llm-groq/archive/ba9d7de74b3057b074a85fe99fe873b75519bd78.zip'\nllm keys set groq\n# \u003cpaste API key here\u003e\nllm -m groq-llama3-70b 'a bad poem about a hungry pelican'\n```",
"sig": "171b366f5d6275dd807d2296b6465fe0a6bfec2ab23d382ca385b8376d5f0f756e6a8dac6a462240e5298278a66f83ec65f63e65c832b0b5ac072f3665b40d1c"
}