00:00:54 <h2ibot> JAABot edited List of websites excluded from the Wayback Machine (+0): https://wiki.archiveteam.org/?diff=51830&oldid=51827
00:20:57 <h2ibot> Bear edited List of websites excluded from the Wayback Machine (+72, Merged my duplicate with existing "www." entry…): https://wiki.archiveteam.org/?diff=51831&oldid=51830
00:37:00 <h2ibot> Bear edited List of websites excluded from the Wayback Machine (+191, Deno, Market-Ticker (not excluded as of 2019)): https://wiki.archiveteam.org/?diff=51832&oldid=51831
00:48:02 <h2ibot> Bear edited List of websites excluded from the Wayback Machine/Former exclusions (+137, unibo.it - excluded in 2014): https://wiki.archiveteam.org/?diff=51833&oldid=51829
01:01:04 <h2ibot> JAABot edited List of websites excluded from the Wayback Machine (+0): https://wiki.archiveteam.org/?diff=51834&oldid=51832
01:05:54 <tzt> did we grab telam.com.ar before it was shut down?
01:12:29 <fireonlive> tzt: looks like there was a job on 20240302: https://archive.fart.website/archivebot/viewer/?q=telam.com.ar https://archive.fart.website/archivebot/viewer/job/202403021304579zj4w
01:20:44 <fireonlive> idk why, but this popped up in my search alerts. so have a look if you haven't seen it already maybe? https://www.youtube-nocookie.com/embed/fYI_XtT7sgQ?rel=0
01:20:57 <fireonlive> "DEF CON 19 - Jason Scott - Archive Team: A Distributed Preservation of Service Attack"
07:00:30 <arkiver> JAA: would it be possible to get those complete notes online?
07:00:56 <arkiver> it would be good to have a possibility again to archive onions
07:01:08 <arkiver> it would not be used for other stuff thouhg
07:01:10 <arkiver> though*
07:01:42 <JAA> Oh, I forgor to actually say it, yeah, I'll try to get those notes into the repo soon.
07:02:18 <arkiver> was this where we previously put the AB Tor WARCs in? https://archive.org/details/archiveteam_tor
07:02:52 <JAA> Yeah
07:03:13 <arkiver> yeah we can push them to there again
07:04:14 <arkiver> among the things we archived back then https://web.archive.org/web/20170828222033/http://dstormer6em3i4km.onion/
07:04:29 <fireonlive> ah! i was just about to ask if onions would be visible in the WBM
07:04:30 <fireonlive> :)
07:04:37 <arkiver> fireonlive: absolutely
07:04:45 <fireonlive> awesome
07:06:16 <arkiver> fireonlive: another https://web.archive.org/web/20170907044151/http://v4gn2k725iokfu4u.onion/
07:06:31 * pabs wonders if we should let the Tor community know about this
07:06:43 <fireonlive> :)
07:06:53 <arkiver> pabs: i think we can treat it as we treat normal AB
07:07:04 <arkiver> pabs: or do you mean the wayback machine viewable stuff?
07:07:22 <arkiver> https://web.archive.org/web/20170906085941/http://highkua2k3ytqdqs.onion/
07:07:27 <pabs> I mean that AB will be saving onions again
07:07:36 <pabs> they might have some ideas of things to save
07:07:36 <fireonlive> hmm, I2P would be interesting one day perhaps
07:08:01 <fireonlive> oh, i was thinking of ipfs
07:08:14 <fireonlive> two different things!
07:08:18 <arkiver> fireonlive: i never looked into I2P much
07:08:23 <arkiver> oh IPFS
07:08:25 * pabs wonders if IA will start sharing things over IPFS :)
07:08:26 <arkiver> yeah maybe
07:08:46 <arkiver> pabs: no idea, i didn't hear much about it
07:08:54 <fireonlive> i saw an I2P link on https://web.archive.org/web/20170907044151/http://v4gn2k725iokfu4u.onion/ and confused it with ipfs for a moment
07:09:27 <arkiver> pabs: yeah on the tor community. at the same time, the general "internet community" would have ideas about what to archive on the internet with AB, and we're not explicitly advertising AB to the world
07:09:36 <arkiver> i think we could treat TorAB the same
07:09:42 <pabs> true
07:10:00 <arkiver> if it makes sense to mention somewhere, we could go "hey, you might want to let AT know, they have a Tor archiving operation running"
07:12:07 <fireonlive> could an existing pipeline be used for tor as well or would it need a new dedi i wonder
07:12:18 <fireonlive> pipeline's server* i guess
07:13:17 <arkiver> probably best answered by JAA ^
07:13:45 <arkiver> but i wonder if we can just disable the Tor one by default, and only enable it when explicitly given as pipeline to run on?
07:14:18 <JAA> I'll have to look for the notes from the 2018 iteration. I think that did some iptables magic. Which *could* be made to work on an existing machine in principle, I guess.
07:14:29 <magmaus3> for example as an parameter?
07:14:42 <JAA> arkiver: Yes, that's how it worked in 2018. The Tor pipelines only processed jobs queued with `--pipeline tor`.
07:14:46 <magmaus3> ah
07:15:25 <arkiver> that could work
07:15:54 <arkiver> maybe with a special !a-tor or so command for h2ibot which subsequently posts a `--pipeline tor` one
07:16:44 <pabs> -p tor isn't too much to type that !a-tor seems needed?
07:17:12 <JAA> Yeah, `--pipeline` = `-p`, so that's short enough, I'd say.
07:19:09 <arkiver> alright
07:38:23 <arkiver> SootBector: we'll likely look now first into getting a tor pipeline on one of the existing machine (or, well, JAA is going to check that)
07:54:56 <pabs> arkiver JAA - another thing to consider is Tor exit node IP reputation varies quite a bit, so being able to rotate exit nodes or choose which country to exit from would be useful
07:55:29 <pabs> the country stuff would be really useful for geoblocked sites that AB curren'tly can't access
07:57:46 <JAA> pabs: IIRC, this kind of stuff is a massive pain to do programmatically. Last time I played with that, the only and poor solution to 'I need a new circuit for X' was 'restart Tor entirely'.
08:00:21 <pabs> I think there are things to do that now. selektor for eg is a GUI. python3-stem for Python
08:00:47 <fireonlive> hmm there's newnym, but it's not granular
08:00:53 <JAA> > Stem is mostly unmaintained.
08:00:55 <JAA> Sounds fun.
08:01:58 <fireonlive> https://spec.torproject.org/control-spec/commands.html#signal
08:02:29 <pabs> also https://github.com/torpyorg/torpy
08:02:58 <pabs> oh, only v2 onions
08:03:51 <JAA> Oh, you can't change the circuit for just a single site at all? TIL.
08:06:01 <JAA> So we'd need a separate Tor instance per job to be able to control the circuit at that granularity at least, I guess. Ugh...
08:06:25 <fireonlive> not up on the new stuff but i don't think so
08:07:09 <JAA> Yeah, I don't see that happening soon.
08:08:37 <fireonlive> yeah indeed..
08:09:54 <arkiver> pabs: does that matter much for .onion addresses?
08:10:08 <pabs> no, only for clearnet stuff
08:10:39 <pabs> exit nodes aren't involved in onion services
09:26:22 <katia> needs kubernetes
13:00:57 <inti83> hi all, how are you? I've been in and out here in regards to Argentina archive
13:01:33 <inti83> So yesterday the main public news provider and archive Telam was taken down, most of it was archived by AB and others luckily
13:02:30 <inti83> And now they are talking of taking down cine.ar, which has most nationally produced cinema. This site is behind Cloudflare so wasn't archived. It was spoken about here that you may have contacts in Buenos Aires to host a local ArchiveBot... Did anythingcome of it?
13:04:50 <inti83> I think JAA mentioned they had contacts in https://www.cabase.org.ar
13:05:22 <inti83> We have some automation in place to use as a way to download the content, but we don't have the space to do it
13:06:33 <inti83> Just to reiterate, the site we are talking about is cine.ar - it has most if not all of the INCAA produced cinema, another organism they are taking down
13:11:34 <pabs> looks like you have to register to watch anything?
13:29:27 <inti83> anyone can register
13:29:43 <inti83> Anyone in Argentina at least
13:30:02 <inti83> I understand at least grab-site and wpull have an authn option
13:59:45 <SootBector> arkiver: JAA  - great.   ping me in any case if the install notes get updated - I have a server mostly sitting idle and would like to try installing just to see how things fit together.
13:59:52 <SootBector> re: selecting Tor exits/countries,  an approach might be to configure a list in torrc each on its own SocksPort    then have AB just change which port it connects to.
14:17:55 <SootBector> sending a different socks username:password (which can be anything) will give you a fresh circuit but not necessarily a different exit
14:41:55 <SootBector> manpage seems to say you can't select ExitNodes [countrycode]   per-SocksPort, but a tor process could be spun up on demand with that option set on the commandline
15:09:47 <SootBector> tor --SocksPort 9090  --ExitNodes {ES}        yes that works
15:32:20 <SootBector> and a map of exits  https://hackertarget.com/tor-exit-node-visualization/
16:01:58 <arkiver> queuing bot will now note when it is started and stopped
16:03:11 <inti83> I have to go now will check logs for any updates, thanks!
16:07:08 <arkiver> there was also a big that caused slots to be hardly found, effectively making one job run at a time, that is fixed now
16:56:07 <fireonlive> https://dl.fireon.live/irc/d6790cdce49fe76f/image.png < “Hidden Birds” site/wiki (from the “TeraLeak” (ugh)) to go down
16:56:34 <fireonlive> oh and forum. not sure at the moment where they reside…
16:56:56 <arkiver> forum is discord here? :P
16:57:13 <fireonlive> ah: https://hiddenbirds.ultra0.ar/
16:57:27 <fireonlive> :P
16:58:14 <arkiver> some day people will discover we archived a ton of imgur, label it a leak, put some stupid name on it, and advertise it as something new they found
16:58:38 <arkiver> fireonlive: they did make the front page of https://hiddenbirds.ultra0.ar/ pretty nice thouhg
16:58:44 <fireonlive> ugh yeah xD
16:58:52 <fireonlive> indeed!
17:02:32 <fireonlive> *someone finds our wiki* “holy crap, leak motherload”
18:14:46 <JAA> inti83: That wasn't me.
18:15:02 <JAA> SootBector: Good info, thanks!
18:17:50 <SootBector> I'll investigate if changing ExitNodes is possible via commands to ControlPort
18:18:18 <JAA> FWIW, integrating that into AB still sounds painful and unlikely to happen soon, but yeah, would be nice.
18:20:32 <SootBector> also found a feature where you append an exit's fingerprint and .exit to the URL's domain to set it on-the-fly.   not yet sure if you can enable that for *
18:31:17 <JAA> inti83: I can access cine.ar fine, but it looks like accessing the content may require registration.
19:07:26 <fireonlive> "Rooster Teeth to shut down" https://twitter.com/geoffkeighley/status/1765424377166708930
19:07:26 <eggdrop> nitter: https://farside.link/nitter/geoffkeighley/status/1765424377166708930
19:08:35 <fireonlive> more details: https://deadline.com/2024/03/rooster-teeth-shut-down-warner-bros-discovery-roost-podcast-continue-1235847264/
19:10:03 <fireonlive> 8.9k videos on their main channel wow lol
19:34:24 <fireonlive> threw the main channel to DTT but will have to return to it later
20:09:37 <mikolaj|m> pabs: might be worth archiving all this, some mailing lists (such as agda and agda-dev) are public https://lists.chalmers.se/mailman/listinfo
22:03:16 <lunik1> + 3.1k on Achievement Hunter, + 4k on Let's Play and there's more besides…
22:39:00 <fireonlive> lunik1: if you have a list of their youtube channels please do let #down-the-tube know
22:39:26 <fireonlive> i haven't been able to return to looking up who/what they are quite yet
22:40:03 <lunik1> will do. won't be exhaustive but I'll send what I remember
22:40:26 <lunik1> what's the preferred pastebin to use?
22:41:00 <katia> https://transfer.archivete.am
22:51:42 <fireonlive> for the channels directly you can `!ac <channel url> -e "https://deadline.com/2024/03/rooster-teeth-shut-down-warner-bros-discovery-roost-podcast-continue-1235847264/"`
22:51:46 <fireonlive> -e is "explain" in this instance
22:52:42 <fireonlive> (anything can be added if it falls within the "scope" of #down-the-tube, explain is to say why it does: https://wiki.archiveteam.org/index.php/YouTube#Scope) but let's take further talk there