It all comes down to this:
> The web is a special place. Every day, it brings people from around the world together to share their thoughts and express their creativity. That's something nobody should take for granted, and it's worth protecting. AI is cool and all, but it's not worth destroying the web.
https://www.macstories.net/stories/ways-you-can-protect-your-website-from-ai-web-crawlers/