What are some best practices for setting up your #backup when working with large files locally on your machine?
For example, I'm working with OpenStreetMap data. The planet is 75 GB in size. I don't need to back that up, I can download it again should the need arise.
However, I'm also creating derived data from it, in files with a similar size, and generating them can take hours. I'd like to have a local backup in case of accidental `rm`, but don't want to clog up my disk with these backups.
scy /
npub15p…khvce
2024-05-27 23:26:01
Author Public Key
npub15pc5vt5kqgr60g389gl4n5zzuktz8wezz76klym9ew3puy3p8clqckhvcePublished at
2024-05-27 23:26:01Event JSON
{
"id": "411fc43ec439e550a78b9827cb957c16348b0d27c0f464e94c9822fb218130cc",
"pubkey": "a071462e960207a7a2272a3f59d042e59623bb2217b56f9365cba21e12213e3e",
"created_at": 1716852361,
"kind": 1,
"tags": [
[
"proxy",
"https://chaos.social/@scy/112515636330978829",
"web"
],
[
"t",
"backup"
],
[
"proxy",
"https://chaos.social/users/scy/statuses/112515636330978829",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://chaos.social/users/scy/statuses/112515636330978829",
"pink.momostr"
]
],
"content": "What are some best practices for setting up your #backup when working with large files locally on your machine?\n\nFor example, I'm working with OpenStreetMap data. The planet is 75 GB in size. I don't need to back that up, I can download it again should the need arise.\n\nHowever, I'm also creating derived data from it, in files with a similar size, and generating them can take hours. I'd like to have a local backup in case of accidental `rm`, but don't want to clog up my disk with these backups.",
"sig": "f1062cd2e821389bba46c487752f302972c4f86517d2f7d28722b04c210adb1e38dfcef0714f17ae7971cec0a17546a1b0d067207d62d757c5b16d3323acf672"
}