I have now recreated that state funded 300k bot by writing the most trivial RAG system imaginable. The answers are on par or better, performance is much better.
Obviously just a proof of concept. But it feeds from the same sources and scales. 2 nights of work.
Point of the exercise:
- State orgs always get fucked in price negotiations for IT projects
- LLMs do NOT belong in vulnerable settings like job services.
Here's a comparison (sorry, it's German :p)
https://www.youtube.com/watch?v=2EeiFlj3KN8
Mario Zechner /
npub1h6…w5nvc
2024-01-07 23:16:47
Author Public Key
npub1h6qmf9h2qfvfgf663q6xl7lh6gt63zr0zzqcteqp8pmy0mls3x6qsw5nvcPublished at
2024-01-07 23:16:47Event JSON
{
"id": "5b5a773b00e8ccdb31c8428243634c821c912f13f8b0cb2b6f81295d71083d58",
"pubkey": "be81b496ea025894275a88346ffbf7d217a8886f108185e401387647eff089b4",
"created_at": 1704669407,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.gamedev.place/users/badlogic/statuses/111717214261252741",
"activitypub"
]
],
"content": "I have now recreated that state funded 300k bot by writing the most trivial RAG system imaginable. The answers are on par or better, performance is much better.\n\nObviously just a proof of concept. But it feeds from the same sources and scales. 2 nights of work.\n\nPoint of the exercise:\n- State orgs always get fucked in price negotiations for IT projects\n- LLMs do NOT belong in vulnerable settings like job services.\n\nHere's a comparison (sorry, it's German :p)\n\nhttps://www.youtube.com/watch?v=2EeiFlj3KN8",
"sig": "68c0b9080fb6dec74e9c187a85cadc81d578abee5ebf841519330c6f2f71a8adf75a9b9ea711862c561ff6502ae6fc804e993df632d4d8f83c4f041e62a22ce1"
}