00:03:48 <h2ibot> Flashfire42 edited List of websites excluded from the Wayback Machine (+31): https://wiki.archiveteam.org/?diff=50285&oldid=50272
00:33:54 <h2ibot> PaulWise edited Mailman2 (+70, more lists, deduplicate lists): https://wiki.archiveteam.org/?diff=50286&oldid=50214
01:00:58 <h2ibot> JAABot edited List of websites excluded from the Wayback Machine (+0): https://wiki.archiveteam.org/?diff=50287&oldid=50285
01:15:06 <fireonlive> "VirtualBox 7.0.10 download links have disappeared" https://news.ycombinator.com/item?id=36841272
01:15:27 <fireonlive> still on the download mirror though
01:18:00 <imer> https://download.virtualbox.org/virtualbox/ that'd be quite a chunk to grab
01:18:06 <imer> probably
01:18:12 <fireonlive> hmm i guess some stuff is broken; apge hasn't been modified according to the wiki history in 10 months
01:18:19 <fireonlive> but a lot of stuff doesn't make sens eon the site lol
01:18:29 <fireonlive> e.g. changelog is blank too https://www.virtualbox.org/wiki/Changelog-7.0
01:19:26 <fireonlive> "[Include(wikitestbuildsfile:changelog-7.0.wiki, text/x-trac-wiki)]]"
01:19:46 <fireonlive> i guess their trac just isn't happy
01:20:49 <fireonlive> via https://www.virtualbox.org/wiki/Changelog-7.0?action=diff&version=2, not sure how to view a page source otherwise
01:20:52 <fireonlive> false alarm i guess :)
04:08:50 <vokunal|m> On the youtube 144p idea, for a while, yt-dlp has a worstvideo setting and bestaudio setting, which I used to use to make sure I at least had the video in some quality, but the audio was still perfectly useable. Might be interesting if this idea gets tossed around a bit more
04:23:46 <flashfire42|m> Donate a bunch to IA and suggest good channels to the current YouTube archival stuff
04:32:21 <fireonlive> anyone have a few million burning a hole in pockets
06:12:53 <h2ibot> Flashfire42 edited List of websites excluded from the Wayback Machine (+24): https://wiki.archiveteam.org/?diff=50288&oldid=50287
07:00:08 <h2ibot> JAABot edited List of websites excluded from the Wayback Machine (+0): https://wiki.archiveteam.org/?diff=50289&oldid=50288
07:20:01 <that_lurker> twitter rebranding as x will break a metric fuckton of links and embeds everywhere unless they still keep twitter.com and just redirect.
07:21:26 <DigitalDragons> twitter project time?
07:21:37 <DigitalDragons> or is it still locked down to accounts only
07:23:45 <that_lurker> still locked down to accounts only
07:24:15 <DigitalDragons> ugh
07:25:47 <that_lurker> good thing is that they seems to only be doing a domain swap to x.com, so everything should maybe hopefully if the start are aligned somewhat good stay the same
07:31:15 <DigitalDragons> I assume that they'll probably only use x.com for the frontend and keep twitter.com in the backend
07:31:35 <DigitalDragons> (like how discord's cdn is still on discordapp.com and such)
07:31:45 <DigitalDragons> i doubt they have the dev bandwidth to do a full domain swap
07:32:49 <that_lurker> we shall hope
07:50:55 <Sennaton> New here, hello.
07:53:14 <that_lurker> Sennaton: Hello. You should also join #archiveteam-ot for somewhat off topic conversations
07:53:34 <Sennaton> K, thanks.
08:56:03 <trainingdata> I run an academic open large language model project https://hplt-project.org/ and am looking for more training data.  We have 10 petabytes of spinning disks attached to high-performance compute and a deal with the Internet Archive for 7 petabytes of WARC, mainly WIDE*.  While I appreciate that archivebot_go has publicly downloadable WARC, is it
08:56:04 <trainingdata> possible to get access to Archive Team: URLs WARCs? For example https://archive.org/download/archiveteam_urls_20230720203029_3f55fb2a is not downloadable.
08:58:24 <thuban> arkiver: i think this is your area ^
12:40:11 <pabs> I sometimes need to parse WARCs to check what was missed by AB jobs, have been resorting to hacky shell so far but want to do something better
12:40:42 <pabs> what libraries are recommended for WARC parsing? preferably with Python bindings
12:42:02 <Maakuth|m> pabs, https://wiki.archiveteam.org/index.php/The_WARC_Ecosystem are you aware of this page?
12:43:09 <pabs> nope, thanks
12:46:02 <pabs> hmm, lots of unmaintained stuff
12:48:28 <Maakuth|m> warcat seems promising, even though only one author
12:49:31 <JAA> warcio is acceptable for WARC parsing/reading, just don't ever write WARCs with it.
12:50:47 <JAA> I've been working (on and off) on a new Python package with a more solid core, but it's not usable yet.
13:03:44 <pabs> the reason I wanted this is to better automate what I did today: discovering open directory indexes/trees that were missed and or contents partially missed
13:03:52 <pabs> anything like that exist yet?
15:52:50 <random> Hello, anyone have the Forward DNS (FDNS) of Project Sonar saved?
18:58:33 <h2ibot> Exorcism edited DokuWiki (+137): https://wiki.archiveteam.org/?diff=50290&oldid=49786