Why Nostr? What is Njump?
2024-06-07 19:32:04

gyptazy on Nostr: Is the crawler from #META / #Facebook acting up again? My traffic monitoring system ...

Is the crawler from #META / #Facebook acting up again? My traffic monitoring system alerted me to some unusual activity on my CDN. Someone was repeatedly downloading the same files. It turns out the Facebook crawler was downloading every file in the directory listing every two hours.

Time to say good bye, crawler. (blocked at 19.30PM)


Author Public Key
npub1qw78tm5s6kez73ed5e89fy0g3n7p0hlga5sqamh3xf48zjtt7uwqa7q0ue