[ale] Ouch, dang it.

[Ron]

lollipopman691 via Ale wrote on 2025-05-29 15:31:

> Has anyone seen this kind of thing before?

There's been a wave of "AI" training bots slamming websites lately.

> Open source devs say AI crawlers dominate traffic, forcing blocks on 
> entire countries

https://arstechnica.com/ai/2025/03/devs-say-ai-crawlers-dominate-
traffic-forcing-blocks-on-entire-countries/


> I currently plan to leave httpd down for a few days and then restart
> it and see if this trouble has gone away. I reckon the long-term
> solution is to move my mail server off the web machine and then just
> let it do its thing?
Long term, probably either block massive blocks of IP addresses or kill 
the web site. (Dead Internet self-fulfilling?)



I've also heard (forget where, probably a podcast) that a lot of these 
requests are coming from residential IPs, making blocking hard.

Speculation is that the bots are on some network that's either provided 
by ISPs looking for a quick buck by renting out IPs within their network 
space, or some kind of malware disguised as a VPN service or something 
being run by consumers themselves.