02:24:33 user_: They all look like they're from the same host. This project can easily ddos websites. Might be better for #archivebot ? 03:46:57 seeing a bunch of spam sites *.zs5g.net 04:14:55 JAA arkiver - Could I please hassle either of you for a blacklist on the following SPAM domain *.zs5g.net slowing us right down :( https://transfer.archivete.am/11dWAy/spam_domain.txt 07:07:41 !a https://transfer.archivete.am/Atu8U/goo-gl.2023-02-14-08-17-05.txt 07:13:33 datechnoman: Skipped 26902 invalid URLs: https://transfer.archivete.am/jmj3p/goo-gl.2023-02-14-08-17-05.txt.bad-urls.txt (for 'https://transfer.archivete.am/Atu8U/goo-gl.2023-02-14-08-17-05.txt') 07:13:34 datechnoman: Deduplicating and queuing 8460976 items. (for 'https://transfer.archivete.am/Atu8U/goo-gl.2023-02-14-08-17-05.txt') 07:22:27 datechnoman: Deduplicated and queued 8460976 items. (for 'https://transfer.archivete.am/Atu8U/goo-gl.2023-02-14-08-17-05.txt') 07:37:16 I just sent this list again in the archivebot channel: https://transfer.archivete.am/10ZqvO/kx-5-28.txt.zst Please remove it from the urls project. 08:26:36 user_ - no worries as we didn't add it to the project :) 15:34:58 datechnoman: I wonder whether this is why the site is so horribly slow. Filter added. 15:41:54 The site is definitely much faster now. 22:08:34 !a https://transfer.archivete.am/13DdX6/discord-Friends_of_the_Internet_Archive 22:08:36 TheTechRobo: Deduplicating and queuing 204 items. (for 'https://transfer.archivete.am/13DdX6/discord-Friends_of_the_Internet_Archive') 22:08:38 TheTechRobo: Deduplicated and queued 204 items. (for 'https://transfer.archivete.am/13DdX6/discord-Friends_of_the_Internet_Archive') 22:08:41 Doranwen: ^ 22:10:26 :) 23:23:25 Thanks so much JAA!