-
nstrom|mseeing a lot of hits for academy.rawlplug.com/login in logs, not sure if it's a weird redirect loop or what
-
JAAAh, those look fun.
-
JAA
-
JAAnstrom|m: Thanks, they're gone.
-
nstrom|mawesome
-
datechnomanShould speed things up much more :D
-
datechnomanJAA - Can you please filter technoportal.ua from the tracker. We are hammering it with thousands of HTTP0 requests
-
datechnomanif you need logs let me know :)
-
JAAOh, I see lots of custom items for sitemaps, yeah.
-
datechnomanYeah tonnes of them
-
datechnomanAtleast we aren't killing the site. Looks like they are just blackholing our traffic
-
datechnomanOn the bright side its only a shopping site so not really something we would run #// over lol
-
JAAThey have 20k sitemaps... WTF?
-
datechnomanWow. I saw what felt like a never ending list but that is hetic
-
JAAAt least that's the ones listed in the main sitemaps, didn't look whether there's layers to it, too.
-
JAA^custom:.*&url=https?%%3a%%2f%%2ftechnoportal%%2eua%%2fsite_maps%%2f is in.
-
datechnomanFrom my worker logs it seems to be all one level
-
datechnomanSo no additional levels but i havent looked inside the root sitemaps for levels either
-
datechnomanYou can see when you filtered it instantly lol
-
datechnomanZooooooooooooom
-
datechnomanThanks mate
-
JAA:-)
-
JAAWe need some graphs again.
-
nicolas17graphs are good
-
nicolas17I have a hunch that lflare tried to add more projects to his grafana and broke it
-
CreaZyp154I'm not seing any .ga in my warrior, have they been queued yet?
-
CreaZyp154I think you can queue this (from logs 20230603) transfer.archivete.am/pC3HI/bns_gabon_domains_ct_partial_dump_01.txt a lot of them are DNS_PROBE_FINISHED_NXDOMAIN
-
CreaZyp154so it shouldn't be too bad ig
-
CreaZyp154(logs on -bs btw)
-
TheTechRobo
-
h2ibotTheTechRobo: Deduplicating and queuing 1023 items. (for 'transfer.archivete.am/O0e9C/discord-Ragtag_Archive')
-
TheTechRoboJAA: ^
-
h2ibotTheTechRobo: Deduplicated and queued 1023 items. (for 'transfer.archivete.am/O0e9C/discord-Ragtag_Archive')
-
CreaZyp154Have you queued .ga domains?
-
datechnomanWe cant archive them if they are all dead
-
CreaZyp154some of them seems up
-
CreaZyp154
-
CreaZyp154but yeah most of them are dead
-
imerare those at risk though? from what I gathered everything that's gonna disappear is gone already
-
CreaZyp154hmm
-
imeralthough just been watching from the sidelines
-
imerso might be wrong
-
JAATheTechRobo: Thanks!
-
TheTechRobo
-
h2ibotTheTechRobo: Deduplicating and queuing 6 items. (for 'transfer.archivete.am/FHgJo/asdf')
-
h2ibotTheTechRobo: Deduplicated and queued 6 items. (for 'transfer.archivete.am/FHgJo/asdf')
-
TheTechRobo
-
h2ibotTheTechRobo: Skipped 8 invalid URLs: transfer.archivete.am/cFNeP/discord-MC_Nation.bad-urls.txt (for 'transfer.archivete.am/SxTiw/discord-MC_Nation')
-
h2ibotTheTechRobo: Fixed 1 unprintable URLs: transfer.archivete.am/tHqOX/discord-MC_Nation.not-printable.txt (for 'transfer.archivete.am/SxTiw/discord-MC_Nation')
-
h2ibotTheTechRobo: Deduplicating and queuing 9319 items. (for 'transfer.archivete.am/SxTiw/discord-MC_Nation')
-
h2ibotTheTechRobo: Deduplicated and queued 9319 items. (for 'transfer.archivete.am/SxTiw/discord-MC_Nation')