sandwich on Nostr: I scrape events and do multi-stage deduplication (stateless dedupe + stateful ...
I scrape events and do multi-stage deduplication (stateless dedupe + stateful dedupe). It is the most difficult part of the process.
Published at
2025-05-24 17:11:54Event JSON
{
"id": "d7bfd2c02778ab7bbbc9c5fe22d9767e0814091ab367d80d21b36edb2991a565",
"pubkey": "e771af0b05c8e95fcdf6feb3500544d2fb1ccd384788e9f490bb3ee28e8ed66f",
"created_at": 1748106714,
"kind": 1,
"tags": [
[
"p",
"e771af0b05c8e95fcdf6feb3500544d2fb1ccd384788e9f490bb3ee28e8ed66f",
"",
"mention"
],
[
"p",
"bd4ae3e67e29964d494172261dc45395c89f6bd2e774642e366127171dfb81f5",
"",
"mention"
],
[
"e",
"c74f3c3080634c1d3f3df01438013ec7f81b129fdc458d7877bc97616030d42b",
"",
"root"
]
],
"content": "I scrape events and do multi-stage deduplication (stateless dedupe + stateful dedupe). It is the most difficult part of the process. ",
"sig": "3156d753d00739c4a83929c629fad86b98256f0ac9becb51df19190579e4cdef725f86208cdd9432c71596cf99d5c2f4adb2083da89de49f71e057304a498a0e"
}
