00:00:10 <h2ibot> JAABot edited CurrentWarriorProject (+4): https://wiki.archiveteam.org/?diff=49206&oldid=49202
04:02:50 <Nick> Hi?
04:09:33 <JAA> Bye.
14:01:31 <schwarzkatz|m> <NickS|m> "Ugh, glad I never tried out Atom..." <- I used atom for a long time, I liked it a lot (still do) but with ceased development, you just can’t compete with vscode when you need to actually code stuff :/
14:02:44 <schwarzkatz|m> Yes, I mean tianya. Looks like my matrix was a bit wonky, the messages above the one I sent were not there when I sent my original message...
14:13:30 <schwarzkatz|m> should I gather a list of thread urls from tianya or is this already being worked on?
15:04:42 <arkiver> schwarzkatz|m: feel free to start gathering
15:05:01 <schwarzkatz|m> Ok
15:05:23 <arkiver> Maakuth|m: do you know where those WARCs are on IA?
15:05:29 <arkiver> of koti.mbnet.fi
15:14:04 <Maakuth|m> arkiver: I don't know if Orldow6^2 uploaded them, but at least they seem to be in the transfer site by quick looks, linked here: https://pad.notkiska.pw/p/mbnet
15:15:02 <Maakuth|m> It doesn't seem like they mentioned an IA URL in #webroasting
15:31:42 <arkiver> schwarzkatz|m: but we will also have discovery through a project
15:32:52 <arkiver> Maakuth|m: ah, is this the stuff for which transfer.archivete.am was used, but it should not be used for that?
15:33:32 <Maakuth|m> I'm afraid so,
15:35:16 <arkiver> alright now I know what this is about
15:35:36 <Maakuth|m> ok. let me know if I can be of help
15:36:45 <Maakuth|m> it seems that I have a full set of those tars on my machine too if some have gone missing from the transfer site for some reason
17:17:07 <benjins> Codecov, a code coverage metrics company, is acquired by Sentry: https://about.codecov.io/blog/codecov-is-joining-sentry-heres-what-you-need-to-know/
17:25:23 <upintheairsheep> Hello, I got some resources about BuzzVideo archival over here https://github.com/yt-dlp/yt-dlp/issues/5330
17:26:18 <upintheairsheep> I also added a bit more metadata to the extractor: https://github.com/upintheairsheep/ytdl-sheep/pull/5/commits/092f88c6f6c2608fbe6a21fb8d2dfa2918deb94a
17:26:47 <upintheairsheep> Question: was buzzvideo put in archivebot yet?
17:28:44 <upintheairsheep> The above issue contains a buzzvideo extractor, which could be pulled into the main yt-dlp and then we could tubeup the whole site's videos.
17:32:37 <arkiver> upintheairsheep: we're not going to tubeup BuzzVideo to IA
17:32:55 <upintheairsheep> Just asking, why?
17:33:11 <arkiver> IA is already being spammed with a ton of tubeup stuff
17:33:14 <upintheairsheep> But you could refer to the extractor to WARC the site's videos
17:33:26 <upintheairsheep> OK, I understand.
17:33:30 <arkiver> buzzvideo will be archived into WARCs in likely a warrior project
17:33:47 <arkiver> you can join #buzzoff for the upcoming buzzvideo project
17:35:02 <upintheairsheep> It would be nice for someone to merge the extractor, as I have been banned for OCD-induced issue spamming without verbose logs
17:35:49 <arkiver> archiveteam does not maintain yt-dlp
17:35:55 <ChrisWsrn> Is there a way to archive a Facebook profile as a logged in user? I have a friend who unexpectedly died about a week ago and I am trying to preserve his legacy.  I am friends with him on facebook so I see more than the public profile shows. Is it possible for me to craw his profile as me and then add it to a archive?
17:36:24 <ChrisWsrn> Ryz told me to ask about this here.
17:36:27 <thuban> ChrisWsrn: warcprox?
17:37:26 <ChrisWsrn> I do not have any archiving skills yet. Is there a wiki page I can take a look at on warcprox?
17:38:18 <schwarzkatz|m> ChrisWsrn: you could try https://github.com/gildas-lormeau/SingleFile until someone comes up with a better idea for facebook.
17:38:18 <schwarzkatz|m> It generates a static html page of the site.
17:38:28 <thuban> not specifically, but there's a readme here: https://github.com/internetarchive/warcprox
17:38:45 <ChrisWsrn> Thanks.
17:38:58 <ChrisWsrn> What should I do with these files I collect?
17:39:22 <thuban> (that said, if you're not comfortable with e.g. the command line, you may not find it user-friendly)
17:39:36 <ChrisWsrn> Command line i am fine with.
17:39:43 <upintheairsheep> Alternatively, you could manually save each page or the entire feed as a single .mhtml file and upload it to the internet archive if that's all you need, and use tubeup with authentication for videos.
17:40:00 <upintheairsheep> Does your friend have any other social media accounts
17:40:26 <thuban> you could upload them to the internet archive. that won't put them in the wayback machine, but it will make them available for download
17:40:58 <upintheairsheep> I'm sorry for your loss, I never suffered through the pain at this moment.
17:41:10 <upintheairsheep> Nobody major died.
17:41:54 <upintheairsheep> You could also download each image by right clicking them and uploading them manually if that's all you need.
17:42:10 <ChrisWsrn> Youtube which Ryz put in #down-the-tube. He had a blog which I added manually with https://web.archive.org/save and I think was added to be crawled by #archivebot. He has a presence on the doomworld fourms and some other fourms. I am still looking for other things.
17:42:59 <arkiver> ChrisWsrn: which blog? we might want to run in through #archivebot to ensure a complete copy is made
17:43:28 <upintheairsheep> #down-the-tube seems to only have metadata and comments, did you archive the videos themselves yet?
17:43:40 <arkiver> #down-the-tube archives the video
17:43:41 <ChrisWsrn> Blog is https://ghastlygaming.wordpress.com/
17:43:42 <arkiver> videos
17:43:51 <arkiver> and the videos will become playable in the Wayback Machine
17:43:55 <ChrisWsrn> It was just added less than a hour ago
17:44:07 <arkiver> ah good i see Ryz covered it
17:52:14 <schwarzkatz|m> arkiver,  I just checked the the thread count for bbs.tianya. we are looking at roughly 122,358,356 threads...
17:52:33 <schwarzkatz|m> 221 subforums
17:53:13 <arkiver> yeah, and roughly an equal number of accounts
17:53:36 <arkiver> (planning on going after all tianya.cn)
17:53:42 <schwarzkatz|m> I have not started crawling anything, but I wrote some documentation on what I gathered so far, should I upload that to the transfer?
17:53:49 <arkiver> yes please!~
17:53:50 <arkiver> yes please!
17:54:01 <arkiver> let's make a channel for tianya.cn!
17:54:19 <arkiver> anyone have ideas for a tianya channel?
17:54:57 <schwarzkatz|m> byenya
17:55:35 <thuban> endoftheworldclub
17:55:48 <thuban> (https://en.wiktionary.org/wiki/%E5%A4%A9%E6%B6%AF)
17:56:30 <thuban> (endoftheendoftheworldclub?)
17:56:41 <arkiver> yeah literally named that in english https://en.wikipedia.org/wiki/Tianya_Club
17:59:09 <schwarzkatz|m> here's what I got so far https://transfer.archivete.am/qHTMP/docu-bbs.tianya.md
18:00:09 <arkiver> looks good
18:00:22 <arkiver> the additional -1 is interesting
18:00:43 <thuban> (hm... can we get /inline/ for .md?)
18:06:04 <schwarzkatz|m> if they exist, the -1 threads are suffixed with a small symbol next to it (cannot ocr the text) and are always the first thread in a subforum.
18:06:04 <schwarzkatz|m> without the additional -1, they redirect to it though so that's good.
18:06:22 <schwarzkatz|m> like here http://bbs.tianya.cn/list.jsp?item=46&order=1
18:39:30 <qw> ?
19:31:00 <mgrandi> Dragalia lost has ended, might be a good idea to do a final run of the website and a comic which doesn't seem to be linked from the main page https://dragalialost.com/sp/en/ https://comic.dragalialost.com/dragalialife/en/
19:33:54 <mgrandi> https://twitter.com/DragaliaLostApp (if there is room in the probably overloaded socialbot space)
21:39:19 <JAA> thuban: /inline/ doesn't do anything special, it just omits the Content-Disposition header to not force a download (so the browser can display the file directly if supported). I'm guessing you mean rendering the Markdown as HTML.
21:39:30 <JAA> That'd be a bit more complicated.
21:56:20 <JAA> atom.io is still horribly slow and throwing 500s all the time. I hope it'll get better soon. Can't really archive the packages at the moment.
21:57:15 <schwarzkatz|m> just in case, the people over at https://pulsar-edit.dev saved all the packages a while ago.
21:57:58 <JAA> But did they do it as WARC so that installing packages inside Atom will still be possible via the WBM after the shutdown?
21:58:04 <JAA> :-)
21:59:20 <JAA> Where can I find more details about what they did?
22:00:00 <schwarzkatz|m> of course not, but at least it's better than nothing.
22:00:00 <schwarzkatz|m> most likely on the discord server: 7aEbB9dGRT
22:00:23 <JAA> :-/
22:01:14 <michaelblob> *sad J_AA noises*
22:01:31 <JAA> Yeah, an imperfect mirror is certainly better than nothing. Also, most packages are public GitHub repos, so they could probably still be installed from there as well.
22:12:11 <schwarzkatz|m> most of the packages are on github, yes. also note that they received a huge of amount of spam after announcing that atom will be deprecated.
22:12:11 <schwarzkatz|m> ...I just checked, it's at 415k now... the amount of actual packages is about 12k. On 2022-08-08 it was 15k.
22:12:11 <schwarzkatz|m> also, here are some related repos: https://github.com/confused-Techie/AtomPackagesArchive
22:12:11 <schwarzkatz|m> https://github.com/confused-Techie/atom-package-collection (used to migrate the packages to the pulsar site)
22:13:17 <schwarzkatz|m> sorry for not thinking of this earlier, I'm not checking in here enough
22:30:35 <JAA> Yeah, I saw the spam. It's actually way more than 415k, no idea where that number comes from. The API returns almost 36k pages with 30 packages each, which also matches the number in the footer: '1,078,592 packages & themes'
22:32:05 <schwarzkatz|m> that's incredible. interesting that they have not preemptively killed the site up until now
22:32:29 <JAA> Yeah, or made it read-only or whatever.
22:34:10 <mgrandi> How did they even handle uploading a theme, just anyone can do it with no review process?
22:34:21 <mgrandi> Or package rather
22:56:32 <ChrisWsrn> I found Ghastlys twitter (He died last week). What should I do to archive this? https://twitter.com/ghastly310
23:04:16 <ChrisWsrn> I also found his bandcamp account, his imgur account, his reddit account, his twitch account (empty), plus "some accounts" that he would not want archived. What tools should be used to archive these accounts?