-
nstrom|mI'm seeing a disproportionate number of sitemaps from subdomains of app.br and gdom.org being queued, might be seo spam junk
-
Exorcismirc.digitaldragon.dev/uploads/319e7e695008b475/image.png okay but why a "warning" ?
-
arkiverExorcism: some government may not want you to connect to Tor
-
arkiveror some providers
-
ExorcismOh i see okay thanks!
-
arkiveryou most certainly go on the "used Tor"-list of various countries (at least the US) if you connect to Tor
-
arkiverimer: yay, it was already odd nothing more showed up
-
arkiverwell - that no expanding loops seemed to show up anymore
-
nyany
-
nyanycatchy name
-
immibisalso some hosting providers hate it, even without good reason. arkiver said I'm not allowed to refer to them as "fascist" any more.
-
arkivernyany: uh :P
-
arkiveri should maybe limit the number of dots in the URLs discovered from PDFs
-
arkiverimmibis: i hope you do agree somewhat with the idea/reason behind ir
-
arkiverit*
-
nyanyarkiver: there are loads more like it
-
nyanyi scaled down on my main box so I could scale up on telegram
-
arkivernyany: yeah they come from the PDFs :/
-
arkiveroverall they should not actually take much resources
-
arkiverfor example PDFs need to be actually processed and scanned for URL, while these very long dead URLs nearly need to processing
-
nyanythat's fair, i have more than enough cpu to handle it
-
arkiveryou can probably go through hundreds/thousands of dead URLs before you reach the same resources used as for a say 50 page PDF (i'm did not measure this at all)
-
nyanyoh my poor i3-2130 server is dying lol
-
nyanythat's the server i call "rectum"
-
arkiversitemaps and PDFs can be heavy :/
-
arkiverlasts the first 3 or 4 days i believe for sitemaps
-
nyany
-
nyanyah yes that's my favorite website
-
nyanymust be a sister site to usercontent.irccloud-cdn.com/file/X2p29P4V/image.png
-
fireonliverectum, hardly knew 'em
-
fireonlive:3