20250602 - Fighting the AI scraper bots
Manage episode 486458677 series 3662020
We are lucky they are so very stupid.
Text version: https://pivot-to-ai.com/2025/06/02/fighting-the-ai-scraper-bots-at-pivot-to-ai-and-rationalwiki/
Patreon: https://www.patreon.com/davidgerard
Ko-Fi: https://ko-fi.com/A1529D5
Buy me nice things: https://www.amazon.co.uk/hz/wishlist/ls/3Q8VZW46J6DM6
Get an extremely cool Pivot to AI shirt or mug: https://pivot-to-ai.redbubble.com
Sources:
1 Million Third-Party Android Devices Have a Secret Backdoor for Scammers https://www.wired.com/story/1-million-third-party-android-devices-badbox-2/
jwz's Blog: https://www.jwz.org/blog/
Previously on Pivot to AI:
What the floods of AI scraper bots look like in 2025 https://pivot-to-ai.com/2025/03/02/what-the-floods-of-ai-scraper-bots-look-like-in-2025/
That RationalWiki configuration fragment:
set $BOT ""; if ($uri ~* (/w/index.php)) { set $BOT "C"; }
Full Pivot to AI playlist: https://www.youtube.com/playlist?list=UU9rJrMVgcXTfa8xuMnbhAEA
72 episodes