01:43:51 <nstrom|m> seeing a lot of hits for https://academy.rawlplug.com/login in logs, not sure if it's a weird redirect loop or what
01:45:25 <JAA> Ah, those look fun.
01:45:42 <JAA> Stuff like this:  https://academy.rawlplug.com/login?pcip=2vO4mMsX1E7iiKsxu6BiMyY_PD-z41sJfVgkvjr47G-_htjR7K1H3w&%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BDB%0B%EF%BF%BDR%EF%BF%BD%DC%BF%60%EF%BF%BD%0A%EF%BF%BD%3B%EF%BF%BD%13%EF%BF%BD%EF%BF%BD%09_%05%EF%BF%BD%DE%A0m%EF%BF%BD%EF%BF%BD.%EF%BF%BD/%D5%A4%1C%EF%BF%BD
01:48:06 <JAA> nstrom|m: Thanks, they're gone.
01:48:18 <nstrom|m> awesome
01:52:10 <datechnoman> Should speed things up much more :D
03:30:20 <datechnoman> JAA - Can you please filter https://technoportal.ua from the tracker. We are hammering it with thousands of HTTP0 requests
03:31:27 <datechnoman> if you need logs let me know :)
03:32:23 <JAA> Oh, I see lots of custom items for sitemaps, yeah.
03:32:41 <datechnoman> Yeah tonnes of them
03:33:11 <datechnoman> Atleast we aren't killing the site. Looks like they are just blackholing our traffic
03:36:55 <datechnoman> On the bright side its only a shopping site so not really something we would run #// over lol
03:37:08 <JAA> They have 20k sitemaps... WTF?
03:37:26 <datechnoman> Wow. I saw what felt like a never ending list but that is hetic
03:37:36 <JAA> At least that's the ones listed in the main sitemaps, didn't look whether there's layers to it, too.
03:38:39 <JAA> ^custom:.*&url=https?%%3a%%2f%%2ftechnoportal%%2eua%%2fsite_maps%%2f is in.
03:38:43 <datechnoman> From my worker logs it seems to be all one level
03:38:58 <datechnoman> So no additional levels but i havent looked inside the root sitemaps for levels either
03:39:18 <datechnoman> You can see when you filtered it instantly lol
03:39:21 <datechnoman> Zooooooooooooom
03:39:28 <datechnoman> Thanks mate
03:39:46 <JAA> :-)
03:40:02 <JAA> We need some graphs again.
03:40:24 <nicolas17> graphs are good
03:42:10 <nicolas17> I have a hunch that lflare tried to add more projects to his grafana and broke it
07:01:09 <CreaZyp154> I'm not seing any .ga in my warrior, have they been queued yet?
07:39:49 <CreaZyp154> I think you can queue this (from logs 20230603) https://transfer.archivete.am/pC3HI/bns_gabon_domains_ct_partial_dump_01.txt a lot of them are DNS_PROBE_FINISHED_NXDOMAIN
07:40:27 <CreaZyp154> so it shouldn't be too bad ig
07:40:53 <CreaZyp154> (logs on -bs btw)
12:21:40 <TheTechRobo> !a https://transfer.archivete.am/O0e9C/discord-Ragtag_Archive
12:21:41 <h2ibot> TheTechRobo: Deduplicating and queuing 1023 items. (for 'https://transfer.archivete.am/O0e9C/discord-Ragtag_Archive')
12:21:41 <TheTechRobo> JAA: ^
12:21:43 <h2ibot> TheTechRobo: Deduplicated and queued 1023 items. (for 'https://transfer.archivete.am/O0e9C/discord-Ragtag_Archive')
12:27:36 <CreaZyp154> Have you queued .ga domains?
12:35:12 <datechnoman> We cant archive them if they are all dead
12:59:46 <CreaZyp154> some of them seems up
13:01:51 <CreaZyp154> http://aninf.ga/
13:02:04 <CreaZyp154> but yeah most of them are dead
13:02:16 <imer> are those at risk though? from what I gathered everything that's gonna disappear is gone already
13:02:29 <CreaZyp154> hmm
13:02:32 <imer> although just been watching from the sidelines
13:02:42 <imer> so might be wrong
18:59:30 <JAA> TheTechRobo: Thanks!
22:26:42 <TheTechRobo> !a https://transfer.archivete.am/FHgJo/asdf
22:26:45 <h2ibot> TheTechRobo: Deduplicating and queuing 6 items. (for 'https://transfer.archivete.am/FHgJo/asdf')
22:26:46 <h2ibot> TheTechRobo: Deduplicated and queued 6 items. (for 'https://transfer.archivete.am/FHgJo/asdf')
22:50:21 <TheTechRobo> !a https://transfer.archivete.am/SxTiw/discord-MC_Nation
22:50:26 <h2ibot> TheTechRobo: Skipped 8 invalid URLs: https://transfer.archivete.am/cFNeP/discord-MC_Nation.bad-urls.txt (for 'https://transfer.archivete.am/SxTiw/discord-MC_Nation')
22:50:27 <h2ibot> TheTechRobo: Fixed 1 unprintable URLs: https://transfer.archivete.am/tHqOX/discord-MC_Nation.not-printable.txt (for 'https://transfer.archivete.am/SxTiw/discord-MC_Nation')
22:50:28 <h2ibot> TheTechRobo: Deduplicating and queuing 9319 items. (for 'https://transfer.archivete.am/SxTiw/discord-MC_Nation')
22:50:30 <h2ibot> TheTechRobo: Deduplicated and queued 9319 items. (for 'https://transfer.archivete.am/SxTiw/discord-MC_Nation')