Carl Malamud on Nostr: Copying 54,184 volumes of Sanskrit books (~20 TB total, includes the raw scan files) ...
Copying 54,184 volumes of Sanskrit books (~20 TB total, includes the raw scan files) from a zfs pool on an ubuntu server onto a solid state disk pack ("SSP", a disk enclosure which has 8x16tb SSDs that fits in the palm of your hand). I'm getting 159.25 MBs throughput on this copy. Takes about 40 hours to finish. When full (100TB), I can get about 250,000 books on this SSP, which I can throw into my carryon luggage.
Published at
2024-09-17 00:50:11Event JSON
{
"id": "757fddf669b802670555d06f05d971ffba9d01ec028ec40f759a82767019cd99",
"pubkey": "90f384354abe76f3b92eb97ea37d090b96bc95081ad203d256c4cb8ee242f819",
"created_at": 1726534211,
"kind": 1,
"tags": [
[
"proxy",
"https://official.resource.org/@carlmalamud/113150146107331132",
"web"
],
[
"proxy",
"https://official.resource.org/users/carlmalamud/statuses/113150146107331132",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://official.resource.org/users/carlmalamud/statuses/113150146107331132",
"pink.momostr"
],
[
"-"
]
],
"content": "Copying 54,184 volumes of Sanskrit books (~20 TB total, includes the raw scan files) from a zfs pool on an ubuntu server onto a solid state disk pack (\"SSP\", a disk enclosure which has 8x16tb SSDs that fits in the palm of your hand). I'm getting 159.25 MBs throughput on this copy. Takes about 40 hours to finish. When full (100TB), I can get about 250,000 books on this SSP, which I can throw into my carryon luggage.",
"sig": "e2492bc038b3e04083e5104dc25e7ea15de46ff62eba1ebdade28d44f86e3870f829efbf20b65d0b8fcf7288e10d9efefe616598c5f4250bac0720b7a9b1a62b"
}
