-
nyany
datechnoman: the internet is really really great~
-
datechnoman
It's full of great things they say
-
Ryz
datechnman, is that a joke? o.o;
-
Ryz
*datechnoman
-
arkiver
hmm
-
arkiver
i'm going to stash away mp4s for noq
-
arkiver
now*
-
arkiver
when the queue is down, we'll put the mp4s into long term backlog
-
datechnoman
Yeah a slow trickle feed later on is a great idea
-
datechnoman
Go zoomies now :D
-
datechnoman
The queue is a little more controlled now
-
datechnoman
Hiw many mp4s have we got stashed already. Bet that would be growing rapidly atm lol
-
arkiver
datechnoman: 180k
-
arkiver
but the largest majority of that comes from :todo:secondary
-
arkiver
so actually it's not that much
-
arkiver
and i also don't see a huge number of archived mp4s in the past days, it's just the average size of them is very high
-
arkiver
and yeah things are definitely running better!
-
datechnoman
Ahhh nice well thats good news then. Should be able to slow feed that layer on easy
-
datechnoman
Thanks for that :)
-
arkiver
.
-
albertlarsan68
?
-
arkiver
i expect roughly half a day more of backfeed somewhat increasing
-
arkiver
after that we should be slowly going down
-
datechnoman
arkiver - there is a loop on this pdf file that is constantly occurring - 23=200
bizgbi.com/news/pdf/380-Chu-tich-GB…%E1%BB%87tpage%C4%91o%C3%A0nVi%E1%B
-
datechnoman
B%87t%C4%91o%C3%A0npagepageVi%E1%BB%87tpagepageVi%E1%BB%87tpage%C4%91o%C3%A0nVi%E1%BB%87tpage%C4%91o%C3%A0nVi%E1%BB%87t%C4%91o%C3%A0nVi%E1%BB%87tVi%E1%BB%87tpageVi%E1%BB%87tVi%E1%BB%87t%C4%91o%C3%A0n%C4%91o%C3%A0n%C4%91o%C3%A0nVi%E1%BB%87t%C4%91o%C3%A0npageVi%E1%BB%87tVi%E1%BB%87tpagepageVi%E1%BB%87tpageVi%E1%BB%87tpagepagepage%C4%91o%C3%A0npage%C4
-
datechnoman
%91o%C3%A0n%C4%91o%C3%A0n%C4Vi%E1%BB%87tVi%E1%BB%87tpage%C4%91o%C3%A0npagepageVi%E1%BB%87tpagepageVi%E1%BB%87tpagepage%C4%91o%C3%A0npageVi%E1%BB%87tpagepageVi%E1%BB%87tpage%C4%91o%C3%A0npageVi%E1%BB%87tpagepageVi%E1%BB%87t%C4%91o%C3%25pagepage%C4%91o%C3%A0n
-
datechnoman
Seems each time it's accessed a unique url is generated
-
datechnoman
Nothing major but atleast 20-30 hits a min just for my workers
-
datechnoman
Sometimes a lot more
-
arkiver
datechnoman: taking that one out
-
arkiver
it's out! thank you :)
-
datechnoman
arkiver thanks! I'm sure the website admins will thank you
-
nyany
I've checked again this morning and my OVH works are still unable to run the URLs project.
-
nyany
*OVH workers
-
datechnoman
arkiver - looks like that PDF issue is still occuring but much worse now -
transfer.archivete.am/GppD8/pdf_urls.txt
-
eggdrop
-
datechnoman
Just an FYI :)
-
arkiver
datechnoman: hmm, how is it now? (maybe a few minutes from now)
-
nyany
This is the current error (for me) and I believe this is the same as yesterday.
-
nyany
-
datechnoman
arkiver - looks like its completly dropped off now thanks :)
-
nyany
Alright, I've got to step out - If you figure anything out that I might be able to leverage to my advantage, arkiver, please let me know :D
-
datechnoman
rewby rewby|backup could I please hassle you for a quick target health check? Been super spikey for the last 12 hours
-
datechnoman
Something seems off
-
rewby|backup
I'll check
-
rewby|backup
datechnoman: It appears youtube is going at it hard.
-
rewby|backup
They've queued > 6k vids in the last day
-
rewby|backup
Actually much more than that
-
rewby|backup
Probably closer to 10k based on a cursory glance
-
rewby|backup
Anyway, there's a pile of video warcs chugging through
-
rewby|backup
It'll clear eventually
-
rewby|backup
datechnoman: ^ It's been looked into and uh, "just deal with it" appears to be the answer
-
rewby|backup
They're enjoying uploading 0.5G videos
-
rewby|backup
Given the numbers I'm seeing, the target is doing a great job
-
rewby|backup
Just not with this project per-se
-
datechnoman
Ahhh cheers mate! Thanks for looking into it I thought youtube was on another target. I'll check next time! rewby|backup
-
datechnoman
Optane is always busy chugging through stuff xD
-
datechnoman
AT keeps it busy for sure
-
datechnoman
Things are running normal here again :)
-
nyany
Just wanted to update - Neither of my OVH workers are able to work on URLs, still. The error is the same as the one posted this morning. Both workers are able to work on other projects just fine (and are currently chugging happily on telegrab / youtube)