For the curious, today's scraperbot attack on @lwn has run to well over 800,000 unique IP addresses in the last few hours.
We've made some tweaks that are holding it off for now, but it is ongoing and could go bad again at any time.
If you are a real user and are being turned away by the site, could you let me know what your user agent is?
Diego Roversi
in reply to Jonathan Corbet • •I notice that few hours ago access to lwn timed out.
My user agent is: "Mozilla/5.0 (X11; Linux x86_64; rv:140.0) Gecko/20100101 Firefox/140.0"
Jonathan Corbet
Unknown parent • • •@liw Ah, so you are part of the scraper problem :)
Seriously, though, our content is CC-licensed once it escapes the paywall, so your archive is entirely authorized in truth.
Countermeasures are helping for the moment; I do not expect it to be a long-lasting thing.
Closing in on 1M unique IPs this morning. The net is broken.
Jonathan Corbet
in reply to Jonathan Corbet • • •