00:57:44 <flashfire42> is tracker supposed to be paused still?
01:42:19 <rktk> blah-ray.blogspot.com
01:42:32 <rktk> https://wiki.archiveteam.org/index.php/Blogger#Downloading_a_single_blog_with_Wget
01:42:47 <rktk> the updated script here for blogspot does not seem to dowload all the articles as found on this blog. it only grabs maybe... 10 ish.
01:42:58 <rktk> am I doing something wrong? or should I just poke the wikibot
02:25:49 <h2ibot> TheTechRobo edited Dev/New Project (+1234, Add some more details; feel free to correct me…): https://wiki.archiveteam.org/?diff=50469&oldid=48530
02:30:50 <h2ibot> TheTechRobo edited Dev/Seesaw (+311, Note that much of this is outdated and that the…): https://wiki.archiveteam.org/?diff=50470&oldid=23600
02:31:50 <h2ibot> TheTechRobo edited Dev/Tracker (+38, Improve the link to the Docker container): https://wiki.archiveteam.org/?diff=50471&oldid=50326
02:42:41 <arkiver> something is not right with backfeed yet
02:44:00 <flashfire42> Yeah I thought that was still the case
02:44:52 <h2ibot> Arkiver uploaded File:Gfycat-icon.jpg: https://wiki.archiveteam.org/?title=File%3AGfycat-icon.jpg
02:45:19 <nicolas17> remember to ramp up the rate limit slowly when we come back...
02:48:13 <fireonlive> 9999999999999999/sec tbh
02:48:48 <nicolas17> problem is flashfire42 alone will get all those 9999999999999999
02:48:54 <nicolas17> then get banned
02:49:11 <nicolas17> then kill the targets with the sudden upload flood
02:49:50 <nicolas17> we should buy arkiver one of these to adjust the rate limit https://m.media-amazon.com/images/I/61a9wzv6VnL._AC_UF894,1000_QL80_.jpg
02:49:54 <flashfire42>  https://server8.kiska.pw/uploads/91b08eb93179162f/I%20aplogise%20for%20nothing.mp4
02:51:11 <fireonlive> flashfire42: :D
02:57:51 <TheTechRobo> we need a big red button for the admins to set the ratelimit to 0
03:02:19 <nicolas17> TheTechRobo: those exist too
03:02:28 <TheTechRobo> Ik :P
03:02:30 <nicolas17> button needs a molly-guard too
03:02:33 <nicolas17> for full aesthetics
03:02:46 <TheTechRobo> someone in the Uplink discord did that for a 'Disconnect' binding
03:02:50 <PL12>  Los Angeles Radio People (www.laradio.com), a website about radio personalities that could be heard on Los Angeles radio stations will shut down for a second time, this time permanently, because of the owner's liver cancer spreading. Source: https://old.reddit.com/r/LosAngeles/comments/15qbofu/la_radio_website_closing_host_is_leaving/
03:04:09 <PL12> www.laradio.com is excluded from the WB, and archive today has a partial backup
03:05:01 <PL12> www.laradio.com's Archives access is paid
03:06:16 <nicolas17> TheTechRobo: I saw someone who got a toilet flush pull chain to disconnect from the video call
03:06:55 <\> nice
03:07:52 <nicolas17> https://hackaday.com/2020/12/28/a-pull-chain-to-end-your-zoom-pain/
03:09:56 <TheTechRobo> nicolas17: https://transfer.archivete.am/inline/5atUg/2023-07-12_22-20-12.mp4
03:10:03 <TheTechRobo> (not my video)
03:12:30 <\> video is their own person, and does'nt belong to anyone
03:12:36 <arkiver> \: nice
03:12:42 <\> :3
03:12:53 <arkiver> JAA: ^ :P
05:06:26 <project10> how does one set the rsync_threads value when running a pipeline manually/through docker (i.e. not the warrior with its config UI)? Do I need to use "--context-value"?
05:32:54 <Video> \: what lmao
05:33:29 <DigitalDragons> project10: You shouldn't need to mess with rsync stuff. When running through docker you should use this command or similar: docker run -d --name X --label=com.centurylinklabs.watchtower.enable=true --restart=unless-stopped atdr.meo.ws/archiveteam/X-grab --concurrent 6 DigitalDragon
05:33:46 <DigitalDragons> (obviously, replace DigitalDragon with your own username, and replace 6 with the concurrency you want to run at)
05:33:57 <DigitalDragons> (and X is the project name)
05:35:00 <DigitalDragons> Running the projects on bare metal (ie, without docker) isn't supported anymore
05:36:38 <fireonlive> Video: :D
05:36:40 <appledash> Which is stupid mind you
05:37:02 <fireonlive> is it though
05:37:30 <fireonlive> delicious yummy consistent environments mmmmmmmmm
05:37:39 <fireonlive> 😋
05:38:09 <DigitalDragons> fireonlive stop eating the docker containers
05:38:33 <DigitalDragons> they don't contain food
05:38:34 <DigitalDragons> :p
05:38:51 <fireonlive> *mouth full* they don't?
05:42:56 <aninternettroll> they have _laaayers_
05:43:09 <Exorcism> 😭
06:38:13 <Video> is it just becoming a common occurrence for people to jokingly ping me lol
06:52:04 <\> Video: cant believe you killed the radio star tbh
06:53:24 <Video> you are not the first to make that joke I'm afraid
06:53:58 <\> darn
06:54:12 <\> for the zoomers: https://youtu.be/W8r-tXRLazs
07:12:56 <project10> DigitalDragons: sorry, I wasn't clear. I am not running it 'bare metal', it's through a docker-compose setup. Still, I'm wondering, is it possible to tweak rsync_threads via docker args/env, like I can with the warrior ui?
07:16:22 <rewby|backup> project10: To what end? For what purpose?
07:22:09 <project10> to hammer the targets ;)
07:22:38 <project10> just finding that the default of 2 didn't keep up with a concurrency of 20, e.g. on the urls project
07:23:24 <project10> what is the purpose of exposing the tunable in the warrior ui?
07:33:50 <rewby|backup> Ask arkiver
07:34:02 <rewby|backup> But usually, people are fine with concurrency 2
07:34:13 <rewby|backup> Although I think the default could be like 6 or whatever
07:34:40 <rewby|backup> But iirc its 2 per pipeline?
07:35:09 <rewby|backup> Oh actually
07:35:40 <project10> seems to be, yeah. it's just a shitty ovh kimsufi, it seems they throttle individual flows. Aggregate I can do 100mbps but individual tcp flows are only like 5-10mbps
07:35:43 <rewby|backup> arkiver: I think you have rsync threads set as a typo in urls grab. Default is 20 in other projects and only 2 for urls.
07:36:26 <rewby|backup> project10: Looks like it's a typo. It's 20 on all other projects as a default.
07:36:31 <project10> seems to be 2 for youtube-grab as well
07:37:23 <rewby|backup> Interesting
12:12:17 <immibis> throttling flows isn't necessarily a hosting thing, it could also be a configuration thing at either end
12:12:28 <immibis> there's a whole thing about TCP and "bandwidth delay product"
12:13:09 <immibis> where if it's high, one end sends the maximum amount of data it's willing to send without an acknowledgement, and then has to wait for an acknowledgement before it sends more. There are supposed to be algorithms to avoid this being a problem, but...
14:03:08 <nstrom|m> Do we want to unpause telegram, reddit, imgur now that backfeed is fixed?
14:06:21 <arkiver> rewby|backup: do we want to up it to 20? fine with me
14:06:48 <arkiver> historically it used to be lower so slow connections don't clog things up
16:04:29 <rewby|backup> arkiver: Make it like 10 for now
16:47:42 <arkiver> rewby|backup: alright, will update the projects
18:39:50 <h2ibot> FireonLive edited Current Projects (+0, move Gfycat to current): https://wiki.archiveteam.org/?diff=50473&oldid=50456
18:41:51 <h2ibot> FireonLive edited Gfycat (+109, let's-a-go!): https://wiki.archiveteam.org/?diff=50474&oldid=50353
18:53:53 <h2ibot> FireonLive edited Current Projects (+0, Move DPReview to on haitus?): https://wiki.archiveteam.org/?diff=50475&oldid=50473
19:26:50 <nicolas17> btw during the tracker downtime, a lot of items accumulated in the reddit tracker
19:28:02 <nicolas17> so we could use some more workers there - but don't spend extra money or stop other projects for it :P
19:28:38 <Barto> why not both? :-)
19:29:13 <nicolas17> run it in parallel to other projects!
19:30:30 <Barto> *exactly*
19:30:46 <Barto> *run all projects*, except url-grab if its your home internet
19:53:37 <nicolas17> reddit pushing 200MiB/s
20:30:49 <nicolas17> reddit ETA 20h
20:35:45 <fireonlive> 12:40:51 PM -+rss- We mourn the loss of Stefan Tilkov: https://www.innoq.com/en/news/2023/08/stefan-tilkov-english/ https://news.ycombinator.com/item?id=37124373
20:59:23 <project10> what is the "round trip time" in the context of the tracker? rtt to/from where?
21:00:54 <nicolas17> I think it's average time between someone getting an item and returning it completed
21:01:02 <nicolas17> but it might not be "average"
21:01:19 <project10> ah, so end to end time of an item/claim?
21:42:45 <hauntedwagon> Hi
21:42:58 <hauntedwagon> Does anyone here know who ran Blingee?
23:00:38 <h2ibot> JAABot edited CurrentWarriorProject (-1): https://wiki.archiveteam.org/?diff=50476&oldid=50433