02:39:23 OrIdow6: Pretty much all of ff.n has been backed up by various people in the fic archival community. I have entire fandoms myself, but only the ones I'm interested in (and for my fandoms, only the English langauge - I'm not interested in being the repository of everything ever, lol). But I know of someone who's already dumped quite a bit to IA. 02:39:55 But it's anyone's guess how the ff.n situation will progress, lol. Their latest update was here: https://x.com/FictionPress/status/1812241025928409122 02:39:55 nitter: https://nitter.privacydev.net/FictionPress/status/1812241025928409122 02:41:01 Someone on r/fanfiction already posted a DNS workaround. I haven't tested it as I don't visit the site all that often. But if it's not back up tomorrow (unlikely given it's a weekend), I'll probably try editing my hosts file and see if I can make it work that way, so I can get the latest links to run through fichub-cli. 02:41:19 Since my next update of some fandoms is due tomorrow. 04:52:58 fanfiction.net is back up for me 05:27:50 Mmm, has there been attempts on archiving FanFiction.net? Though the Cloudflare stuff is...a problem, and remains a problem 05:50:47 remind me again are we doing something about https://abload.de/ 07:17:57 Ryz: No idea, though it'd be nice if someone archived the reviews. At this point if the site went down, I'd be able to read just about all the fics easily enough, but that'd be it. (Fortunately, it's now back to its usual clunky normal. Complete with Cloudflare being a pita when trying to go read a fic on there, which just reminded me to go read it from my offline stash instead, haha.) 07:24:22 To illustrate the sorry state of podcast preservation: Barack Obama and Michelle Obama have both had podcasts and neither of them are on archive.org. (I'm archiving them right now.) 07:44:51 yarrow: podcasts are not being archived into the Wayback Machine 07:45:10 they're not? 07:51:58 Is anyone aware of any large-scale projects for automatically archiving podcasts with public RSS feeds? 07:51:58 yarrow: if the feeds are in wikidata, then urls-sources & IA will download the podcasts /cc arkiver 07:52:14 I guess that's not correct? 07:58:09 does urls-sources put the stuff it archives into wayback machine? 08:19:39 nimaje: yes 08:20:08 yarrow: yeah it's not correct, those feeds are there just to archive the feeds themselves 08:20:25 there is a podcast archiving project though yes, but it does not store the podcasts in the Wayback Machine 08:20:54 Flashfire42: no on abload.de 08:21:52 Doranwen: As for "Pretty much all of ff.n has been backed up by various people in the fic archival community" - do you havn links? Especially for recent stuff (seemingly they started with the aggressive anti-bot measures in the late 2010s?) 08:25:41 Do the podcasts end up on archive.org? As I noted above, I've been surprised by how many podcasts are NOT on archive.org. I've archived about 180 manually so far myself and I've seen very few examples of something already being archived when I check to see if I should do it. 08:26:25 Doranwen: As I'd like to document taht on the ArchiveTeam wiki 08:29:29 OrIdow6 edited Shutdown rumors, hoaxes, and scares (+228, Fanfiction.net): https://wiki.archiveteam.org/?diff=52745&oldid=51793 09:01:04 yarrow: how do you archive podcasts btw? do you just yt-dlp the feed and yeet all the episodes into one item? 09:04:53 I use a tiny, obscure program from GitHub called PodcastBulkDownloader to download the feed. Then, yeah, I put all episodes in one item with cover art and good metadata. 09:05:10 https://archive.org/details/@didyousayboop 09:10:47 The 5-year mortality rate on podcasts with over 100,000 listens has to be something bananas like 30% (and then for podcasts with under 10,000 listens it's gotta be like 80%). 09:11:45 oh 09:14:14 yarrow: yes but archiving has been less intense the last year due to changes in the way the podcasts are being stored 09:14:30 (and PBs had to be switched over to the different way of storing) 09:14:40 that is almost done and archiving will start fully again 09:15:27 How podcasts are being stored internally at the IA? 09:15:45 yeah with the 'items' system, not wayback 09:16:37 Manu created Discourse/archived (+6, start list with archived discourse instances): https://wiki.archiveteam.org/?title=Discourse/archived 09:16:38 Manu edited Discourse/archived (+79, saved forums.lutris.net): https://wiki.archiveteam.org/?diff=52747&oldid=52746 09:17:38 Manu edited Discourse (+55, include list of archived instances): https://wiki.archiveteam.org/?diff=52748&oldid=52228 09:18:37 Manu edited Discourse/uncategorized (-45, forums.lutris.net => /archived): https://wiki.archiveteam.org/?diff=52749&oldid=51202 09:21:49 yarrow: do you keep them updated over time? that's a thing i'd probably struggle with, hence most of the ones i archived are stale ones. 09:24:10 I only started this 2-3 weeks ago, so I haven't done any updating of shows are are still ongoing (a lot have permanently ended). Unfortunately, I don't have any automation set up nor do I have the know-how to do that. 09:24:22 *shows that are still ongoing 09:31:08 arkiver: any idea why Barack Obama's podcast wasn't caught by the automated system? 09:38:05 It came out in early 2021: https://en.wikipedia.org/wiki/Renegades:_Born_in_the_USA 11:00:55 Exorcism edited Bugzilla (+0): https://wiki.archiveteam.org/?diff=52750&oldid=52744 12:17:08 Exorcism edited Bugzilla (+0): https://wiki.archiveteam.org/?diff=52751&oldid=52750 13:59:03 katia: And uploading https://archive.org/details/LiveNow-from-Fox-Secret-Services-rushes-trump-off-stage 14:00:05 that_lurker, <3 14:00:10 that_lurker++ 14:00:12 -eggdrop- [karma] 'that_lurker' now has 14 karma! 14:13:20 that_lurker why is their no downloadable or playable/streamable video in that item? confused 14:13:30 *why is there 14:14:51 currently uploading it 14:15:01 live chat is the in json format 14:15:18 ahhhh 14:15:19 uploading BREAKING： Secret Service rushes Trump off stage ｜ LiveNOW from FOX [-C2RyORyX0U].mkv: 2%|█▏ | 203/10310 [24:21<19:18:35, 6.88s/MiB] 14:15:26 I see 14:17:04 Nice work :) 14:52:34 Manu edited Bandcamp (+1203, take note of the Vapor Vault): https://wiki.archiveteam.org/?diff=52752&oldid=50959 15:08:37 Exorcism edited Bugzilla (+0): https://wiki.archiveteam.org/?diff=52753&oldid=52751 16:47:54 Exorcism edited Bugzilla (+41): https://wiki.archiveteam.org/?diff=52754&oldid=52753 16:53:55 Exorcism edited Bugzilla (+34, /* Not yet archived */): https://wiki.archiveteam.org/?diff=52755&oldid=52754 19:19:25 Exorcism edited Bugzilla (+0): https://wiki.archiveteam.org/?diff=52756&oldid=52755 19:22:26 OrIdow6 edited Shutdown rumors, hoaxes, and scares (-24): https://wiki.archiveteam.org/?diff=52757&oldid=52745 19:55:00 yarrow2: just fyi, podcastbulkdownloader works from the podcast rss feed and not a catalog such as apple's, meaning that it will not find back episodes if the rss feed is truncated (as some of them are) 20:17:50 * Harzilein wished the archiving approach would go via synthesizing archive rss feeds where rss feeds are truncated. 20:27:06 podcasts are a mess. i have a grudge against my country's public broadcasters for: a) always shuffling things around with their web platforms b) muddling terminology (i.e. a podcast episode might be called "an audio" internally, but it will inevitably become "a podcast", even if it's not part of a feed) and c) sometimes having "entire news broadcast" feeds of length one. 20:28:28 (of course the segmentized feeds have longer length but it becomes hard to tell then when it really got broadcasted first) 21:19:46 Exorcism edited Bugzilla (+38, /* Not yet archived */): https://wiki.archiveteam.org/?diff=52758&oldid=52756 21:20:46 Exorcism edited Bugzilla (+32): https://wiki.archiveteam.org/?diff=52759&oldid=52758 21:36:49 Exorcism edited Bugzilla (+0): https://wiki.archiveteam.org/?diff=52760&oldid=52759