Anthropy :verified_dragon: on Nostr: I'm thinking, people keep saying ML is so inefficient for information retrieval and ...

I'm thinking, people keep saying ML is so inefficient for information retrieval and all that.. but I actually think it would be hypothetically feasible to create a search transformer/RAG, that is MORE efficient at its task of simply returning relevant links for the user (especially considering the size of the internet nowadays), than a classical index based search engine. That may seem like a challenge given the extensive optimization of the latter, but I think an ANN could do it even better 🤔