14000 kind 1 notes is about 7MB in nostrdb. Heaviest is contact lists. 4000 lists are about 70mb [1]. These are stored in a compact binary format so they are pretty space efficient, but it’s amazing how many notes there are floating around. I hit 14000 text notes after a few minutes of use.
Working on #nostrdb pruning logic so that #damus will use less space. We probably don’t need to store everything, so I am working on making sure only the important stuff sticks around the longest (profiles, etc). Storing text notes is nice for when we add note searching.
danieldaquino (npub13v4…l3l8) has been working on more aggressive image cache pruning. Images make up most of the storage space, so we’re making sure damus as space efficient as possible for the next release.
It’s nice to be back hacking on damus 🤗 whats everyone working on today?
[1] https://cdn.jb55.com/s/64418a4c0e35247e.txt
jb55 /
npub1xt…vkk5s
2023-11-14 19:18:01
Author Public Key
npub1xtscya34g58tk0z605fvr788k263gsu6cy9x0mhnm87echrgufzsevkk5sPublished at
2023-11-14 19:18:01Event JSON
{
"id": "e95bf2e4668c8a4dc82dc02461d451dfcb52a04448d5a9ea8adbe56b5baf0e5b",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1699989481,
"kind": 1,
"tags": [
[
"t",
"nostrdb"
],
[
"t",
"damus"
],
[
"p",
"8b2be0a0ad34805d76679272c28a77dbede9adcbfdca48c681ec8b624a1208a6"
],
[
"r",
"https://cdn.jb55.com/s/64418a4c0e35247e.txt"
]
],
"content": "14000 kind 1 notes is about 7MB in nostrdb. Heaviest is contact lists. 4000 lists are about 70mb [1]. These are stored in a compact binary format so they are pretty space efficient, but it’s amazing how many notes there are floating around. I hit 14000 text notes after a few minutes of use.\n\nWorking on #nostrdb pruning logic so that #damus will use less space. We probably don’t need to store everything, so I am working on making sure only the important stuff sticks around the longest (profiles, etc). Storing text notes is nice for when we add note searching.\n\nnostr:npub13v47pg9dxjq96an8jfev9znhm0k7ntwtlh9y335paj9kyjsjpznqzzl3l8 has been working on more aggressive image cache pruning. Images make up most of the storage space, so we’re making sure damus as space efficient as possible for the next release.\n\nIt’s nice to be back hacking on damus 🤗 whats everyone working on today?\n\n[1] https://cdn.jb55.com/s/64418a4c0e35247e.txt",
"sig": "e5cc57805723b76f0586969f54df447bca617d2a15f38a5772dfd094df47af40c33d2d70cc93fb4c85d0264d5d32f798fc5b03a0ccff35e48073c52a7ebe1d43"
}