00:37:37 <Ryz> Hmm, I'm pondering on doing more proactive archiving on anything Blogspot related, I stumbled upon https://fieldsofhether.blogspot.com/2016/04/we-spend-way-too-much-time-digging.html during internet searching, but it doesn't exist anymore,
00:37:58 <Ryz> https://web.archive.org/web/20181226201600/http://fieldsofhether.blogspot.com/2016/04/we-spend-way-too-much-time-digging.html exists - I was initially wondering if the website got cybersquatted or something, but nope, the website still holds up more or less
00:38:15 <Ryz> The big trouble that made me gaze my eye a bit wider is at the bottom of the page in the website in general:
00:38:26 <Ryz> "404 Errors & Missing Links"
00:38:29 <Ryz> Followed by,
00:38:44 <Ryz> "Please note that some of my posts are currently being removed by blogger. They are then reviewed, and put back - so the post may be there one day, missing the next, and back a week later. I have no control over this unfortunately. For all the latest free svgs, be sure to check out the facebook group for this page - and if you have any suggestions
00:38:44 <Ryz> on other website hosts, I am currently looking at options."
00:40:44 <Ryz> ...So yeah, I'm not sure if those removals were automated or what, and the person had to try and retrieve it
00:40:48 <fireonlive> :|
00:41:15 <fireonlive> i could see google throwing some ill advised ML at 'spam detection'
00:41:58 <flashfire42> Ryz so can Blogspot be hit as hard as tumblr?
00:42:59 <Ryz> flashfire42, eeeeeh, I'm not too sure, I think the individual posts are fine, but the pagination navigation will suffer if hit too harshly S:
00:43:44 <Ryz> Also, there's some funkyness on archiving Blogger profiles, as they're quite strict with that giving 429s for too much checking too many times
00:43:48 <fireonlive> https://krebsonsecurity.com/ used to be blogspot... but i think that changed during the big ddosing, can't find a source article anymore
00:43:50 <Ryz> ...And other stuff that I found out
00:45:16 <pabs> Barto: ISTR you often do company acquisitions archiving
00:46:52 <pabs> superkuh, JAA: re mastodon, either append /embed to the URL to get plain HTML of the single post, or use zygolophodon in a terminal to get the thread https://github.com/jwilk/zygolophodon
00:47:58 <pabs> re attachment content disposition, there is a browser extension that lets you override any content type/disposition for any request and set your own
00:51:07 <JAA> fireonlive: If true, it must've been much longer ago I think. On the big DDoS a few years ago (the one that was a record at the time), it was Akamai dropping him. But I believe he was already using a self-hosted Wordpress blog for years prior to that.
00:51:26 <JAA> pabs: Good to know re /embed, shame that it's only the single post though.
00:51:47 <JAA> And yeah, there are several extensions like that.
00:52:08 <fireonlive> ahh
00:52:10 <pabs> yeah, I usually do /embed to determine if I want to read the thread, then go zygolophodon in a terminal to read it
00:52:13 <fireonlive> kk
00:52:20 <fireonlive> my krabs timelines are super fuzzy
00:52:41 <JAA> zygolophodon looks interesting, hadn't seen it before, thanks!
01:01:28 <h2ibot> Flashfire42 edited URLTeam/Warrior (+54, /* Warrior projects */): https://wiki.archiveteam.org/?diff=50265&oldid=48605
01:11:30 <h2ibot> Flashfire42 edited URLTeam/Warrior (+67, /* Warrior projects */): https://wiki.archiveteam.org/?diff=50266&oldid=50265
01:40:14 <pabs> JAA: IIRC it uses the same APIs used by the JS frontend, because they work without being logged in
02:12:57 <superkuh> pabs, thanks for the /embed tip. I'll try that. zygolophodon is okay but quite a hassle to leave the browser.
06:38:24 <h2ibot> Entartet edited List of websites excluded from the Wayback Machine (+24, Added zainamro.com.): https://wiki.archiveteam.org/?diff=50267&oldid=50192
13:00:19 <pabs> is there a Vimeo project? manu|m said on #archivebot this person died https://vimeo.com/channels/suemarxfilms
14:03:12 <ShakespeareFan00> Hi.
14:03:40 <ShakespeareFan00> Has there been any progress on this :- https://wiki.archiveteam.org/index.php/Usenet ?
14:03:54 <ShakespeareFan00> Google Groups is for most groups effectively unusable
14:04:31 <ShakespeareFan00> And Google certainly has removed entire groups like uk.railway and comp.lang.oberon rather than actually clean out spam.
14:06:11 <nstrom|m> that's so sad
14:10:40 <ShakespeareFan00> I'm especially annoyed in respect of uk.railway,  because I was flagging spam in that group in the hope that someone reasonable would actually tackle the issue.
14:10:57 <ShakespeareFan00> (But this is the wrong forum for calling out Google's behaviour.)
14:11:33 <ShakespeareFan00> Running an NTTP server to collate current postings to various NNTP groups is  a technical feasibility.
14:11:49 <ShakespeareFan00> That way  'new' content to those groups will not be lost.
14:12:25 <ShakespeareFan00> However,  there is the issue of archives Google and other servers clearly hold, but which can;t be accessed.
14:13:21 <ShakespeareFan00> BTW Is there an effort to 'archive' sites like Discord?
14:13:53 <ShakespeareFan00> (Aside:  I can retrive material I posted to Discord,  but I can't retrieve the replies from others.)
14:15:03 <nstrom|m> discord is very archival unfriendly, they seem to be trying really hard to keep their stuff a walled garden
14:18:50 <ShakespeareFan00> Well , some of it's almost certainly GDPR...
14:19:02 <ShakespeareFan00> Or equivalent...
14:20:16 <ShakespeareFan00> One other suggestion I had for future archival work , is  archiving the responses from Bing/OpenAI etc...
14:20:52 <ShakespeareFan00> (Yes those responses are effectively random fictions right now, but it helps to have evidence of the mistakes they are making)
14:21:03 <ShakespeareFan00> Not sure how you'd archive them though,
14:22:06 <ShakespeareFan00> BTW I can't currently suggest things like Discord archival on the Wiki, as I had a disagreement with a wiki mod several years ago.
16:25:43 <albertlarsan68> FWIW, I am currently building an Edge extension to collect all interesting links (Imgur, Mediafire). Let me know if you want more URLs or IDs.
16:47:07 <albertlarsan68> I plan on submitting its findings, is there any problems with that?
16:48:06 <rewby> We have IRC bots you can use to submit imgur and mediafire links I think
16:58:38 <fireonlive> we do
16:58:47 <fireonlive> and submit away they take anything
16:59:14 <fireonlive> only limits i’m aware of is #down-the-tube where’s there’s criteria (explained in the wiki, exceptions granted on case by case basis)
17:00:45 <fireonlive> (dtt is for youtube)
18:09:58 <Barto> pabs: ah, that is true
18:10:17 <Barto> gotta do it then :)
18:13:26 <fireonlive> pabs: https://wiki.archiveteam.org/index.php/Vimeo saeems no
18:36:34 <albertlarsan68> Great! Once I have around 100 matches, I will dump them. i use the (very wide) regexes in the wiki pages, so there may be many false positives. Hope it works, and that I will be useful!
18:38:43 <fireonlive> :) no worries about fps, bot can filter those out
18:44:49 <VickoSaviour> did we collected all of the Wysp data?
18:54:33 <fireonlive> lol