girinovey on Nostr: Fresh results just in. Slicestore is 3 to 5 times faster than lmdb without indexes, ...
Fresh results just in. Slicestore is 3 to 5 times faster than lmdb without indexes, or with indexes that do not reduce much the search space (kind). And 5 to 10 times faster when indexes are used (id and author)
Store time is also significantly lower: 885.7112ms (less than 1 second) to load 241727 events (223M of data), while lmdb takes more than an hour to load that much data (1h13m25.6085427s)
i'll try it on my desktop, with a faster nvme SSD and see if it makes any difference
Published at
2024-10-27 22:10:12Event JSON
{
"id": "32aa9ea6b27b9a0cedd848cbef2274189194db5018e9e031f15fe71dbba68127",
"pubkey": "3ffac3a6c859eaaa8cdddb2c7002a6e10b33efeb92d025b14ead6f8a2d656657",
"created_at": 1730067012,
"kind": 1,
"tags": [
[
"e",
"206e8b9aa98f5793524f80df692e335073bb863a1bce3a12d5c08e0e8c886d53",
"wss://nostr.girino.org/",
"root"
],
[
"e",
"7b4de57f7bdbd3f9ab83f2b24725edcfd671db2c5809a915d988cf63f70891c3",
"",
"reply"
],
[
"p",
"3ffac3a6c859eaaa8cdddb2c7002a6e10b33efeb92d025b14ead6f8a2d656657"
],
[
"p",
"e2ccf7cf20403f3f2a4a55b328f0de3be38558a7d5f33632fdaaefc726c1c8eb"
]
],
"content": "Fresh results just in. Slicestore is 3 to 5 times faster than lmdb without indexes, or with indexes that do not reduce much the search space (kind). And 5 to 10 times faster when indexes are used (id and author)\n\nStore time is also significantly lower: 885.7112ms (less than 1 second) to load 241727 events (223M of data), while lmdb takes more than an hour to load that much data (1h13m25.6085427s)\n\ni'll try it on my desktop, with a faster nvme SSD and see if it makes any difference\n\n\nhttps://nostrcheck.me/media/3ffac3a6c859eaaa8cdddb2c7002a6e10b33efeb92d025b14ead6f8a2d656657/8d3e9f4bf67ac350132f8aa2e835d5e93c3220ed97ddc0b96ca1edb724fb553b.webp",
"sig": "2aa9a16395d42b259cdd7ccded13f137a7c44969c60dd6e9870042519741f6d47e6daa2ba5b0defb74943e73b4205258a7f068d8d62094eb9f22af9da61ce010"
}