pleblee on Nostr: I looked for a non-janky sidebar/extension for Chromium to add LLM integration but ...
I looked for a non-janky sidebar/extension for Chromium to add LLM integration but came up short. So trying it out with Brave. It let's you add openai api-compatible endpoints, so I dropped in my local litellm instance. This way I can bring my api key and use claude (Brave wants to charge a subscription fee for the same thing).
Text copypasta in case you want to try it:
- Model request name: `claude-3.7-sonnet`
- Server endpoint: `
http://127.0.0.1:8031/v1/chat/completions`
- System Prompt:
> The current time and date is %datetime%. You are **Pleb**, a helpful AI assistant. Assist web browser users with clear, concise, and technical responses. **Guidelines:** - **Conciseness:** Keep responses under 6 sentences or 80 words.
And here's the relevant part of `litellm.yaml`:
```
model_list:
- model_name: claude-3.7-sonnet
litellm_params:
model: anthropic/claude-3-7-sonnet-latest
api_key: os.environ/ANTHROPIC_API_KEY
```
Published at
2025-03-31 20:39:15Event JSON
{
"id": "36bc157394caf0cfad6ea16e328adaa95d2d1b58fad1673fcb6c293179d6a26f",
"pubkey": "69a0a0910b49a1dbfbc4e4f10df22b5806af5403a228267638f2e908c968228d",
"created_at": 1743453555,
"kind": 1,
"tags": [
[
"r",
"https://image.nostr.build/64e810394be9baeba5b6bdd48bba830bced551fff8ee86f06673157891790d88.png"
],
[
"r",
"http://127.0.0.1:8031/v1/chat/completions`"
],
[
"r",
"claude-3.7-sonnet"
],
[
"r",
"os.environ/ANTHROPIC_API_KEY"
],
[
"imeta",
"url https://image.nostr.build/64e810394be9baeba5b6bdd48bba830bced551fff8ee86f06673157891790d88.png",
"x 251a01c2ea8e3e0abbac597ae2445816983a96a9aad5324fe00b250adfb20b9c",
"size 59129",
"m image/png",
"dim 698x1028",
"blurhash ^34o4r_4-=%Nj]RiI9M^RhRiWBa$%Nxwt8t8j[WAM^M^M_WAoet8xv%NxvogWBRjW9RiW9j=ofogohxv%Mt8j]WAxtj;WAaxWBj]M|ogxuogofax",
"ox 251a01c2ea8e3e0abbac597ae2445816983a96a9aad5324fe00b250adfb20b9c",
"alt "
]
],
"content": "I looked for a non-janky sidebar/extension for Chromium to add LLM integration but came up short. So trying it out with Brave. It let's you add openai api-compatible endpoints, so I dropped in my local litellm instance. This way I can bring my api key and use claude (Brave wants to charge a subscription fee for the same thing).\n\nhttps://image.nostr.build/64e810394be9baeba5b6bdd48bba830bced551fff8ee86f06673157891790d88.png\n\nText copypasta in case you want to try it:\n\n- Model request name: `claude-3.7-sonnet`\n- Server endpoint: `http://127.0.0.1:8031/v1/chat/completions`\n- System Prompt:\n \u003e The current time and date is %datetime%. You are **Pleb**, a helpful AI assistant. Assist web browser users with clear, concise, and technical responses. **Guidelines:** - **Conciseness:** Keep responses under 6 sentences or 80 words. \n\nAnd here's the relevant part of `litellm.yaml`:\n```\nmodel_list:\n - model_name: claude-3.7-sonnet\n litellm_params:\n model: anthropic/claude-3-7-sonnet-latest\n api_key: os.environ/ANTHROPIC_API_KEY\n```",
"sig": "17df956ea47ee5022f4ea5bb46d81f1155ab02f7c0f9910d01d58cd6e19fe53ee23ce48136191fa95ddbca223da846f9eb1263166235beb816eaa36a55b28902"
}
