-
nicolas17
I think there should be a way for people here to temporarily add a pattern to the filter
-
nicolas17
if it's wrong, it will expire or an admin will remove it, if it's right, an admin can make it permanent
-
nicolas17
that way we don't have to wait for arkiver/JAA to deal with endless loops
-
arkiver
imer: i will check that one again
-
arkiver
nicolas17: i don't know, adding a pattern is dangerous. it means loss of data
-
arkiver
at least in the way things are currently set up
-
datechnoman
-
h2ibot
-
h2ibot
-
h2ibot
-
h2ibot
datechnoman: Deduplicating and queuing 9996017 items. (6677DCIu)
-
pocketnyany
Heya
-
pocketnyany
Did we find a juicy batch of outline
-
pocketnyany
Outlinks or is todo going crazy?
-
imer
arkiver: how did the check go? :D (do tell me off if I'm being a pest at this point, starting to feel bad about poking you repeatedly)
-
arkiver
imer: you're not a pest at all
-
arkiver
i do have a problem with getting distracted - so many interesting things to do :)
-
arkiver
nyany: regarding your question, datechnoman queued a bunch of PDFs
-
arkiver
imer: so it redirects to interesting images with a 302->301->200
-
arkiver
the 301 is where it goes wrong, since we queue that back as it's supposed to be permanent
-
arkiver
maybe they want the cookie or something
-
arkiver
(didn't check it fully)
-
arkiver
but i'm going to create a new option to allow following 301s on some patterns, like the one for this
-
nstrom|m
that sounds like a decent hack for this
-
arkiver
imer: nstrom|m: fixed! tested and works
-
imer
thanks! :)
-
arkiver
we got a new apparatus on our toolset now to handle these odd 3xx loops :)
-
arkiver
and new version forced
-
arkiver
doing some experiment that may cause loops, we'll see, can always revert
-
arkiver
moving current backfeed to secondary
-
arkiver
update pushed
-
arkiver
this will create new loops
-
arkiver
will filter them out as we go along
-
arkiver
we were not getting some PDFs even though we could, hopefully that is now fixed
-
nicolas17
arkiver: okay, I thought the items would not get sent to users but stay in the queue, I guess that's a whole different mechanism (patterned tracker rate limits?)
-
arkiver
nicolas17: yeah that last one is the different one
-
arkiver
hmm loops are happening
-
that_lurker
-
arkiver
paused
-
arkiver
restarted
-
JAA
And pattern limits make the tracker very sad when the highest-priority non-empty queue is mostly limited items.
-
arkiver
paused again
-
arkiver
restarted again
-
arkiver
paused
-
nyany
I'm not having a very good day with tech it seems.
-
» fireonlive gives nyany a cookie
-
arkiver
can't get this done now
-
arkiver
going to turn back to old code
-
arkiver
done
-
nyany
Ugh here we go again
-
fireonlive
nyany: did q9 get back to you?
-
nyany
fireonlive: not yet
-
nyany
But I've just had to manually reset my workers for the fifth time today due to code changes
-
nyany
I'm about to fire the man in the watchtower for not doing his job lol
-
nyany
Now that my workers are working at full strength that queue is dying
-
nyany
Update from Quad9
-
nyany
"We've identified the issue. This only affects 2 global locations.
-
nyany
-
nyany
We're looking to resolve this on Monday or Tuesday the latest."
-
nyany
cc arkiver ^
-
fireonlive
bad watchtower!
-
JAA
Hopefully, they'll monitor for this from now on. :-P
-
JAA
But yeah, not pushing a fix Friday night is probably a good idea.
-
nulldata
Never had the greatest luck with Watchtower. I ended up going to a cron job that recurses my Docker folders and runs docker compose update and docker compose up -d every 15 minutes or so.
-
JAA
It's been mostly fine for me. It does occasionally miss a new image and then only updates at the next run. But I've set the polling interval short enough that it doesn't really matter.