Colby on Nostr: Wild timing… 2 days after I posted this. When the faster and smaller LLMs arrive ...

Wild timing… 2 days after I posted this.

When the faster and smaller LLMs arrive it’s going to be awesome. Gotta prepare everything else first. 🌐🧱
https://x.com/testingcatalog/status/1916091849795653920

quoting
note1ym3…wpxu

Sadly the LLM-based natural language feed filtering is too slow. Won’t be able to launch with that. Siphiwe (npub1ms9…qa0v) benchmarked it. One day it’ll be possible though. Need smaller & faster LLMs.

But don’t worry, a few other goodies are taking its place… I’ll let you all cook on feed filtering while we figure out some Other Stuff. Just hold my beer. 💛🐉