-
TheTechRobouser_: They all look like they're from the same host. This project can easily ddos websites. Might be better for #archivebot ?
-
nstrom|mseeing a bunch of spam sites *.zs5g.net
-
datechnomanJAA arkiver - Could I please hassle either of you for a blacklist on the following SPAM domain *.zs5g.net slowing us right down :( transfer.archivete.am/11dWAy/spam_domain.txt
-
datechnoman
-
h2ibotdatechnoman: Skipped 26902 invalid URLs: transfer.archivete.am/jmj3p/goo-gl.…023-02-14-08-17-05.txt.bad-urls.txt (for 'transfer.archivete.am/Atu8U/goo-gl.2023-02-14-08-17-05.txt')
-
h2ibotdatechnoman: Deduplicating and queuing 8460976 items. (for 'transfer.archivete.am/Atu8U/goo-gl.2023-02-14-08-17-05.txt')
-
h2ibotdatechnoman: Deduplicated and queued 8460976 items. (for 'transfer.archivete.am/Atu8U/goo-gl.2023-02-14-08-17-05.txt')
-
user_I just sent this list again in the archivebot channel: transfer.archivete.am/10ZqvO/kx-5-28.txt.zst Please remove it from the urls project.
-
datechnomanuser_ - no worries as we didn't add it to the project :)
-
JAAdatechnoman: I wonder whether this is why the site is so horribly slow. Filter added.
-
JAAThe site is definitely much faster now.
-
TheTechRobo
-
h2ibotTheTechRobo: Deduplicating and queuing 204 items. (for 'transfer.archivete.am/13DdX6/discord-Friends_of_the_Internet_Archive')
-
h2ibotTheTechRobo: Deduplicated and queued 204 items. (for 'transfer.archivete.am/13DdX6/discord-Friends_of_the_Internet_Archive')
-
TheTechRoboDoranwen: ^
-
Doranwen:)
-
datechnomanThanks so much JAA!