-
AKWoot for dozzle
-
datechnoman
-
h2ibotdatechnoman: Registering 3lhjgyUo for '!a transfer.archivete.am/3eqEj/goo-gl.2023-06-13-22-17-02.txt'
-
h2ibotdatechnoman: Skipped 31620 invalid URLs: transfer.archivete.am/jqXWH/goo-gl.…023-06-13-22-17-02.txt.bad-urls.txt (3lhjgyUo)
-
h2ibotdatechnoman: Deduplicating and queuing 9968322 items. (3lhjgyUo)
-
h2ibotdatechnoman: Deduplicated and queued 9968322 items. (3lhjgyUo)
-
imeromnomnom
-
datechnomanI'm back from holidays. Will feed the beast for a bit 😀
-
datechnomanGetting some packs together atmb
-
datechnomanAtm**
-
datechnoman
-
h2ibotdatechnoman: Registering GEmtlIQi for '!a transfer.archivete.am/Jq26U/goo-gl.2023-06-17-14-17-02.txt'
-
h2ibotdatechnoman: Skipped 30625 invalid URLs: transfer.archivete.am/cPXWt/goo-gl.…023-06-17-14-17-02.txt.bad-urls.txt (GEmtlIQi)
-
h2ibotdatechnoman: Deduplicating and queuing 9969259 items. (GEmtlIQi)
-
datechnoman
-
h2ibotdatechnoman: Registering HcmIAYAw for '!a transfer.archivete.am/CHLHx/goo-gl.2023-06-21-04-17-02.txt'
-
h2ibotdatechnoman: Deduplicated and queued 9969259 items. (GEmtlIQi)
-
datechnoman
-
h2ibotdatechnoman: Registering XrW1X3Z6 for '!a transfer.archivete.am/KtpGO/goo-gl.2023-06-25-08-17-02.txt'
-
h2ibotdatechnoman: Skipped 31131 invalid URLs: transfer.archivete.am/geLhX/goo-gl.…023-06-21-04-17-02.txt.bad-urls.txt (HcmIAYAw)
-
h2ibotdatechnoman: Deduplicating and queuing 9968776 items. (HcmIAYAw)
-
datechnoman
-
h2ibotdatechnoman: Registering YExqnYZo for '!a transfer.archivete.am/y01za/filtered_pdf_files_unique.txt'
-
h2ibotdatechnoman: Skipped 50 invalid URLs: transfer.archivete.am/fboEX/filtere…d_pdf_files_unique.txt.bad-urls.txt (YExqnYZo)
-
h2ibotdatechnoman: Deduplicating and queuing 494563 items. (YExqnYZo)
-
h2ibotdatechnoman: Skipped 30183 invalid URLs: transfer.archivete.am/11qdSe/goo-gl…023-06-25-08-17-02.txt.bad-urls.txt (XrW1X3Z6)
-
h2ibotdatechnoman: Deduplicating and queuing 9969673 items. (XrW1X3Z6)
-
h2ibotdatechnoman: Deduplicated and queued 9968776 items. (HcmIAYAw)
-
h2ibotdatechnoman: Deduplicated and queued 9969673 items. (XrW1X3Z6)
-
arkiverqueue is going up
-
imerslight delay, but it is indeed, what's being loaded into secondary now? :)
-
arkiveroh
-
arkiveri was not completely scrolled down on my backlog :P
-
arkiverwas looking for the reason the queued went up, but when finally scrolling here, it became clear haha
-
arkiverimer: awesomeness
-
imeroops, haha. happens :)
-
imerand awesomeness is always good
-
fireonlivedatechnoman: hope you had a good holiday :)
-
Notrealname1234someone queue this, archivebot can't archive it for some reason, let's see if the urls project work, grabbed from the zol.com.cn api transfer.archivete.am/inline/EY8fL/zol.com.cn_tvgameapks.txt
-
datechnomanThanks fireonlive! Was good but happy to be home :D
-
fireonlive:D
-
imerarchiving withdrawals setting in? :)
-
Notrealname1234
-
imerNotrealname1234: urls probably isnt the right project for this, we're very likely to ddos the site if left unchecked. also don't deal too well with large files (at least on my end I'll likely OOM kill workers if there's many at once)
-
imeralthough spot checking the file sizes are managable
-
Notrealname1234Alright
-
imerwe can do rate limits here, so the final decision isn't mine, not usually something we do though
-
imerso a gentle warning it might not get put in :)
-
Notrealname1234ArchiveBot didn't work for this, so i thought this would work.
-
nstrom|mSeeing a lot of spammy urls at random subdomains under skinlookingyounger.com
-
imerI spotted those earlier too, but all =0 on my end so didnt pay any further attention to it
-
nstrom|mSome are loading for me but site seems to be struggling so maybe we can kill it and it will solve itself
-
JAANotrealname1234: Enhance your calm. I said I'd look into it. But no, this won't go in here.
-
Notrealname1234Well