-
arkiver
this will take a while it seems
-
arkiver
will fix tomorrow
-
datechnoman
arkiver - Seem to be getting millions of hits on spam domains again. They all appear to have the same kind of structure so hopefully it will make it a little easier to clear them out. Here are some examples from my workers. More than happy to provide more examples if required:
-
datechnoman
-
datechnoman
Looks like the /news/ is working and picked up the spam domains lol
-
datechnoman
Silly loops popping out everywhere :o
-
datechnoman
Hand me my rifle....
-
arkiver
yeaj
-
arkiver
those are the same ones I was talking about previously
-
arkiver
they are similar to something that was blocked a week ago or so, then they had /en/
-
arkiver
now /news/ and /pages/. looking into blocking them with the new method
-
arkiver
blegh queue has grown to 45 million already
-
arkiver
luckily these loops are rare.
-
arkiver
fix coming up, will take some time
-
AK
What's the source of todo:secondary?
-
arkiver
whatever I put into it
-
arkiver
usually when todo:backfeed becomes very large, I push it to todo:secondary to create room
-
arkiver
because what we want overall is for todo:backfeed to stay near 0. this means we're 'healthy'
-
arkiver
but if we have a big queue there after a pause or other problem, it get's in the way checking if we're 'healthy', so I push the excess todo:backfeed as backlog to todo:secondary from where it'll be slowly consumed
-
AK
Ahh okay, so we still want to get through secondary, but it won't keep growing like backfeed does
-
AK
(Except when you put more into it of course)
-
AK
all the todo are going down, does the tracker pull a bit from everything when handing out tasks?
-
arkiver
order of importance: todo, todo:backfeed, todo:secondary, todo:redo
-
arkiver
it'll start with todo, then whatever 'room' is left it, it'll get form the next queue, etc.
-
arkiver
also filtered items. if a requested item gets filtered out, it'll request an item from the next queue, etc.
-
AK
Makes sense
-
AK
-
arkiver
yeah :/
-
arkiver
i hope to improve that soon
-
AK
I think I also probably overload this box, at the moment it runs 20 concurrent per thread, might be a case of me needing to slow down a bit
-
arkiver
it could contribute to it yeah
-
datechnoman
Thanks for the update. Wasnt sure if you were aware but sounds like your already on that one :)
-
datechnoman
-
datechnoman
Looks like the import script broke again
-
arkiver
right
-
arkiver
power outage last night... :/
-
arkiver
should let that start automatically
-
datechnoman
I didnt do it!
-
arkiver
guilty until proven innocent for me :P
-
datechnoman
Haha look, your just the go to person
-
datechnoman
Both for getting things fixed and also to be blamed :P
-
datechnoman
When items are uploaded to the todo queue through the bot are they added to the start of that queue or the end?