07:53:50 Woot for dozzle 10:57:00 !a https://transfer.archivete.am/3eqEj/goo-gl.2023-06-13-22-17-02.txt 10:57:00 datechnoman: Registering 3lhjgyUo for '!a https://transfer.archivete.am/3eqEj/goo-gl.2023-06-13-22-17-02.txt' 11:02:39 datechnoman: Skipped 31620 invalid URLs: https://transfer.archivete.am/jqXWH/goo-gl.2023-06-13-22-17-02.txt.bad-urls.txt (3lhjgyUo) 11:02:40 datechnoman: Deduplicating and queuing 9968322 items. (3lhjgyUo) 11:13:39 datechnoman: Deduplicated and queued 9968322 items. (3lhjgyUo) 11:46:27 omnomnom 12:28:04 I'm back from holidays. Will feed the beast for a bit 😀 12:28:14 Getting some packs together atmb 12:28:20 Atm** 12:43:46 !a https://transfer.archivete.am/Jq26U/goo-gl.2023-06-17-14-17-02.txt 12:43:47 datechnoman: Registering GEmtlIQi for '!a https://transfer.archivete.am/Jq26U/goo-gl.2023-06-17-14-17-02.txt' 12:49:01 datechnoman: Skipped 30625 invalid URLs: https://transfer.archivete.am/cPXWt/goo-gl.2023-06-17-14-17-02.txt.bad-urls.txt (GEmtlIQi) 12:49:02 datechnoman: Deduplicating and queuing 9969259 items. (GEmtlIQi) 12:58:02 !a https://transfer.archivete.am/CHLHx/goo-gl.2023-06-21-04-17-02.txt 12:58:03 datechnoman: Registering HcmIAYAw for '!a https://transfer.archivete.am/CHLHx/goo-gl.2023-06-21-04-17-02.txt' 13:01:17 datechnoman: Deduplicated and queued 9969259 items. (GEmtlIQi) 13:02:21 !a https://transfer.archivete.am/KtpGO/goo-gl.2023-06-25-08-17-02.txt 13:02:21 datechnoman: Registering XrW1X3Z6 for '!a https://transfer.archivete.am/KtpGO/goo-gl.2023-06-25-08-17-02.txt' 13:04:22 datechnoman: Skipped 31131 invalid URLs: https://transfer.archivete.am/geLhX/goo-gl.2023-06-21-04-17-02.txt.bad-urls.txt (HcmIAYAw) 13:04:23 datechnoman: Deduplicating and queuing 9968776 items. (HcmIAYAw) 13:08:56 !a https://transfer.archivete.am/y01za/filtered_pdf_files_unique.txt 13:08:57 datechnoman: Registering YExqnYZo for '!a https://transfer.archivete.am/y01za/filtered_pdf_files_unique.txt' 13:11:30 datechnoman: Skipped 50 invalid URLs: https://transfer.archivete.am/fboEX/filtered_pdf_files_unique.txt.bad-urls.txt (YExqnYZo) 13:11:31 datechnoman: Deduplicating and queuing 494563 items. (YExqnYZo) 13:12:13 datechnoman: Skipped 30183 invalid URLs: https://transfer.archivete.am/11qdSe/goo-gl.2023-06-25-08-17-02.txt.bad-urls.txt (XrW1X3Z6) 13:12:14 datechnoman: Deduplicating and queuing 9969673 items. (XrW1X3Z6) 13:19:16 datechnoman: Deduplicated and queued 9968776 items. (HcmIAYAw) 13:24:13 datechnoman: Deduplicated and queued 9969673 items. (XrW1X3Z6) 15:10:35 queue is going up 15:54:21 slight delay, but it is indeed, what's being loaded into secondary now? :) 15:55:55 oh 15:56:05 i was not completely scrolled down on my backlog :P 15:56:22 was looking for the reason the queued went up, but when finally scrolling here, it became clear haha 15:58:11 imer: awesomeness 15:58:59 oops, haha. happens :) 15:58:59 and awesomeness is always good 17:00:33 datechnoman: hope you had a good holiday :) 19:38:46 someone queue this, archivebot can't archive it for some reason, let's see if the urls project work, grabbed from the zol.com.cn api https://transfer.archivete.am/inline/EY8fL/zol.com.cn_tvgameapks.txt 22:15:16 Thanks fireonlive! Was good but happy to be home :D 22:15:32 :D 22:30:34 archiving withdrawals setting in? :) 22:32:33 oh hello https://transfer.archivete.am/inline/EY8fL/zol.com.cn_tvgameapks.txt 22:37:06 Notrealname1234: urls probably isnt the right project for this, we're very likely to ddos the site if left unchecked. also don't deal too well with large files (at least on my end I'll likely OOM kill workers if there's many at once) 22:37:44 although spot checking the file sizes are managable 22:38:37 Alright 22:39:02 we can do rate limits here, so the final decision isn't mine, not usually something we do though 22:39:29 so a gentle warning it might not get put in :) 22:39:36 ArchiveBot didn't work for this, so i thought this would work. 23:21:35 Seeing a lot of spammy urls at random subdomains under skinlookingyounger.com 23:23:20 I spotted those earlier too, but all =0 on my end so didnt pay any further attention to it 23:24:55 Some are loading for me but site seems to be struggling so maybe we can kill it and it will solve itself 23:32:47 Notrealname1234: Enhance your calm. I said I'd look into it. But no, this won't go in here. 23:32:57 Well