xkeeper

welcome to my personal hell

dragon warrior iii for the game boy color describes me as "stubborn", and i'm tempted to agree with that assessment


co-owner tcrf.net. i run an old forum, jul.
i've been around the internet since '01.
i generally feel like the internet
peaked somewhere around '07.


private: @xkeeper-PLUS
18+: @xkeeper-TI


plural / some kind of digital therian thing.
still discovering myself.
all of this is new to me.


discord / telegram
@xkeeper
signal
Xkeeper.99
You must log in to comment.

in reply to @xkeeper's post:

i do not have an easy way of banning multiple ip ranges (even this one is a simple substr check against the first 5/7/8 characters) but that would be the ideal method

same with banning all of russia

One request per minute is rather slow for scrapping. When I was doing it, I was starting the crawler at least at one every 10 seconds but maybe as fast as one every 3 seconds?

it's been going on for at least 24 hours at this point, but it can't be anything else because it's going into deeply fucked urls you can only get to by following several links in, and robots.txt is there to say "no" to everything