-
flashfire42
is tracker supposed to be paused still?
-
rktk
blah-ray.blogspot.com
-
rktk
-
rktk
the updated script here for blogspot does not seem to dowload all the articles as found on this blog. it only grabs maybe... 10 ish.
-
rktk
am I doing something wrong? or should I just poke the wikibot
-
h2ibot
TheTechRobo edited Dev/New Project (+1234, Add some more details; feel free to correct me…):
wiki.archiveteam.org/?diff=50469&oldid=48530
-
h2ibot
TheTechRobo edited Dev/Seesaw (+311, Note that much of this is outdated and that the…):
wiki.archiveteam.org/?diff=50470&oldid=23600
-
h2ibot
TheTechRobo edited Dev/Tracker (+38, Improve the link to the Docker container):
wiki.archiveteam.org/?diff=50471&oldid=50326
-
arkiver
something is not right with backfeed yet
-
flashfire42
Yeah I thought that was still the case
-
h2ibot
-
nicolas17
remember to ramp up the rate limit slowly when we come back...
-
fireonlive
9999999999999999/sec tbh
-
nicolas17
problem is flashfire42 alone will get all those 9999999999999999
-
nicolas17
then get banned
-
nicolas17
then kill the targets with the sudden upload flood
-
nicolas17
-
flashfire42
-
fireonlive
flashfire42: :D
-
TheTechRobo
we need a big red button for the admins to set the ratelimit to 0
-
nicolas17
TheTechRobo: those exist too
-
TheTechRobo
Ik :P
-
nicolas17
button needs a molly-guard too
-
nicolas17
for full aesthetics
-
TheTechRobo
someone in the Uplink discord did that for a 'Disconnect' binding
-
PL12
Los Angeles Radio People (www.laradio.com), a website about radio personalities that could be heard on Los Angeles radio stations will shut down for a second time, this time permanently, because of the owner's liver cancer spreading. Source:
old.reddit.com/r/LosAngeles/comment…dio_website_closing_host_is_leaving
-
PL12
www.laradio.com is excluded from the WB, and archive today has a partial backup
-
PL12
www.laradio.com's Archives access is paid
-
nicolas17
TheTechRobo: I saw someone who got a toilet flush pull chain to disconnect from the video call
-
\
nice
-
nicolas17
-
TheTechRobo
-
TheTechRobo
(not my video)
-
\
video is their own person, and does'nt belong to anyone
-
arkiver
\: nice
-
\
:3
-
arkiver
JAA: ^ :P
-
project10
how does one set the rsync_threads value when running a pipeline manually/through docker (i.e. not the warrior with its config UI)? Do I need to use "--context-value"?
-
Video
\: what lmao
-
DigitalDragons
project10: You shouldn't need to mess with rsync stuff. When running through docker you should use this command or similar: docker run -d --name X --label=com.centurylinklabs.watchtower.enable=true --restart=unless-stopped atdr.meo.ws/archiveteam/X-grab --concurrent 6 DigitalDragon
-
DigitalDragons
(obviously, replace DigitalDragon with your own username, and replace 6 with the concurrency you want to run at)
-
DigitalDragons
(and X is the project name)
-
DigitalDragons
Running the projects on bare metal (ie, without docker) isn't supported anymore
-
fireonlive
Video: :D
-
appledash
Which is stupid mind you
-
fireonlive
is it though
-
fireonlive
delicious yummy consistent environments mmmmmmmmm
-
fireonlive
😋
-
DigitalDragons
fireonlive stop eating the docker containers
-
DigitalDragons
they don't contain food
-
DigitalDragons
:p
-
fireonlive
*mouth full* they don't?
-
aninternettroll
they have _laaayers_
-
Exorcism
😭
-
Video
is it just becoming a common occurrence for people to jokingly ping me lol
-
\
Video: cant believe you killed the radio star tbh
-
Video
you are not the first to make that joke I'm afraid
-
\
darn
-
\
-
project10
DigitalDragons: sorry, I wasn't clear. I am not running it 'bare metal', it's through a docker-compose setup. Still, I'm wondering, is it possible to tweak rsync_threads via docker args/env, like I can with the warrior ui?
-
rewby|backup
project10: To what end? For what purpose?
-
project10
to hammer the targets ;)
-
project10
just finding that the default of 2 didn't keep up with a concurrency of 20, e.g. on the urls project
-
project10
what is the purpose of exposing the tunable in the warrior ui?
-
rewby|backup
Ask arkiver
-
rewby|backup
But usually, people are fine with concurrency 2
-
rewby|backup
Although I think the default could be like 6 or whatever
-
rewby|backup
But iirc its 2 per pipeline?
-
rewby|backup
Oh actually
-
project10
seems to be, yeah. it's just a shitty ovh kimsufi, it seems they throttle individual flows. Aggregate I can do 100mbps but individual tcp flows are only like 5-10mbps
-
rewby|backup
arkiver: I think you have rsync threads set as a typo in urls grab. Default is 20 in other projects and only 2 for urls.
-
rewby|backup
project10: Looks like it's a typo. It's 20 on all other projects as a default.
-
project10
seems to be 2 for youtube-grab as well
-
rewby|backup
Interesting
-
immibis
throttling flows isn't necessarily a hosting thing, it could also be a configuration thing at either end
-
immibis
there's a whole thing about TCP and "bandwidth delay product"
-
immibis
where if it's high, one end sends the maximum amount of data it's willing to send without an acknowledgement, and then has to wait for an acknowledgement before it sends more. There are supposed to be algorithms to avoid this being a problem, but...
-
nstrom|m
Do we want to unpause telegram, reddit, imgur now that backfeed is fixed?
-
arkiver
rewby|backup: do we want to up it to 20? fine with me
-
arkiver
historically it used to be lower so slow connections don't clog things up
-
rewby|backup
arkiver: Make it like 10 for now
-
arkiver
rewby|backup: alright, will update the projects
-
h2ibot
FireonLive edited Current Projects (+0, move Gfycat to current):
wiki.archiveteam.org/?diff=50473&oldid=50456
-
h2ibot
FireonLive edited Gfycat (+109, let's-a-go!):
wiki.archiveteam.org/?diff=50474&oldid=50353
-
h2ibot
FireonLive edited Current Projects (+0, Move DPReview to on haitus?):
wiki.archiveteam.org/?diff=50475&oldid=50473
-
nicolas17
btw during the tracker downtime, a lot of items accumulated in the reddit tracker
-
nicolas17
so we could use some more workers there - but don't spend extra money or stop other projects for it :P
-
Barto
why not both? :-)
-
nicolas17
run it in parallel to other projects!
-
Barto
*exactly*
-
Barto
*run all projects*, except url-grab if its your home internet
-
nicolas17
reddit pushing 200MiB/s
-
nicolas17
reddit ETA 20h
-
fireonlive
-
project10
what is the "round trip time" in the context of the tracker? rtt to/from where?
-
nicolas17
I think it's average time between someone getting an item and returning it completed
-
nicolas17
but it might not be "average"
-
project10
ah, so end to end time of an item/claim?
-
hauntedwagon
Hi
-
hauntedwagon
Does anyone here know who ran Blingee?
-
h2ibot