-
datechnoman
-
h2ibotdatechnoman: Registering 8fB7VFl6 for '!a transfer.archivete.am/e39vA/filtered_cdn.discordapp.com'
-
h2ibotdatechnoman: Something went wrong. (8fB7VFl6)
-
datechnoman
-
h2ibotdatechnoman: Registering kffzuiwa for '!a transfer.archivete.am/e39vA/filtered_cdn.discordapp.com.txt'
-
h2ibotdatechnoman: Deduplicating and queuing 5917 items. (kffzuiwa)
-
h2ibotdatechnoman: Deduplicated and queued 5917 items. (kffzuiwa)
-
datechnomansilly me
-
fireonlivedatechnoman: thank the gods for the bloom :3
-
datechnomanThe bloom is real
-
fireonliveyeee
-
datechnoman
-
h2ibotdatechnoman: Registering y0xM18jr for '!a transfer.archivete.am/iINdb/filtered_cdn.discordapp.com.txt'
-
h2ibotdatechnoman: Deduplicating and queuing 6140 items. (y0xM18jr)
-
h2ibotdatechnoman: Deduplicated and queued 6140 items. (y0xM18jr)
-
arkiveri'm stashing the PDFs away for now
-
arkiverthere may also be some slowness due to many filters, will move those into the project
-
arkiverimer: i hope the new update to the code will not increase CPU usage too much
-
arkiver100+ filter patterns from the tracker are now moved to the repo
-
arkiverah it's also the first of the month... which means sitemaps
-
arkiverit's good to set the pdfs aside for now as we work through that as well
-
arkiverRIP CPUs
-
AKHappy new month!
-
AK18:25:00 up 36 days, 5:06, 1 user, load average: 325.36, 445.59, 499.13
-
AKCan confirm, CPU is melting
-
imerarkiver: are the filters just checked one by one or is there some extra compiling step going on?
-
imerif not might be worth investigating if thats a thing the lua regex lib can do
-
AKInteresting how quickly I seem to be getting a cpu drop with the new urls-grab release too
-
arkiverimer: one by one
-
imerthere isnt such a thing as far as I can see
-
arkiverit's all sequential, so a ton of checks happening
-
arkiverit has slowed us down in the past
-
arkiverwith the current number in there it could again
-
arkivernew minimum version is forced
-
arkiverfilters that were moved to the code (all of them) have now been removed from the tracker
-
fireonlive*happy tracker noises*