Mazin on Nostr: Doing some initial testing of our new event ingress pipeline tonight! It’s insanely ...
Doing some initial testing of our new event ingress pipeline tonight! It’s insanely cool and already yielding great insights.
Much easier to separate legitimate users from spam when you’re looking at 10 of their events instead of 1.
The problem: when a brand new pubkey starts sending events, it can be difficult to tell immediately whether they are a legitimate user or spam.
Our solution: accept all new user notes temporarily in a separate database. As they send events, we continually evaluate their behavior based on several rules (and eventually by a trained model) and approve/block the pubkey.
If approved, all of their old events get added to our aggregator relay and the user is immediately discoverable. Their future notes will also go directly to the relay. If blocked, the events are sent to a purged database (for transparency and evaluation) and never reach our relay.
Still an early WIP but coming along! It doesn’t solve all the issues but it is a massive improvement on our current rules. note19kp…6nxp
Published at
2024-09-20 00:09:59Event JSON
{
"id": "c55de15f5c1c59d794aa54923b3c8cdec69f632e07aca908ed79f14f6a43e8b4",
"pubkey": "3d842afecd5e293f28b6627933704a3fb8ce153aa91d790ab11f6a752d44a42d",
"created_at": 1726790999,
"kind": 1,
"tags": [
[
"p",
"3d842afecd5e293f28b6627933704a3fb8ce153aa91d790ab11f6a752d44a42d"
]
],
"content": "Doing some initial testing of our new event ingress pipeline tonight! It’s insanely cool and already yielding great insights. \n\nMuch easier to separate legitimate users from spam when you’re looking at 10 of their events instead of 1. nostr:note1x34ktps200flc3mxexzly6ky44gf99hde0wt07qvj3n907kylncq89n656",
"sig": "6debd1467e426d8839972ceb0eb4d80eea3e4257c067173dabbfe6e72ac962bd5fcb15c3c4a8ceadcd1e21daae5de073b1f70752509984f827f072eee532f50c"
}