-
JAA
If anyone has an account at the Supercell forums, please get in touch with me. There is a lot of content that is apparently available only to registered users (but without further restrictions like manual approval or whatever). I'd like to archive that as well, although it probably won't go into the WBM.
-
somerando3
@thuban on the rthk podcasts: a better source for metadata than podchaster is the wayback machine copies of the RSS, it has more links than the podchaser dump I posted earlier.
-
somerando3
I think I saved away the RSS files somewhere, but I can't find them now. They should be pretty easy to get.
-
somerando3
I threw all the links into jdownloader for open line open view and backchat from the RSS and my podchaser dumps, and have already downloaded it all, though I'm not sure what to do with it. I suspect there's still gaps for open line open view, but I've yet to check, and I don't think they're too big.
-
somerando3
I was able to download stuff back to Jan 2014. It seems like they implemented their 1000 link limit only a couple years ago, so once you get there the RSS will span back to 2014.
-
somerando3
There's RSS from before 2014, but it looks like they reorganized things and the links no longer work as-is.
-
somerando3
The files may still be out there somewhere on a different server, but none of my guesses yielded anything.
-
thuban
my one reservation with getting metadata directly from the rss feed (i've been getting it from the rthk page for each episode) is that sometimes the descriptions are truncated--will have to poke around and see whether that's a problem in this case / whether i can get it from other sources (wbm copies, podcast scrapers)
-
thuban
got a link for some of the pre-2014 urls?
-
themadpro
atdash.meo.ws requires a log in now?
-
themadpro
Uh... how do I sign up?
-
h3ndr1k
I guess its juat for core team members (sorry if you are one :) ) It got overloaded at some last project.
-
OrIdow6
I've been told it's broken
-
pabs
"Now more than ever we need surveillance camera man. ... Unfortunately youtube has repeatedly deleted his videos over the years and we are currently in such a period"
news.ycombinator.com/item?id=27904820
-
pabs
aw, none are available on youtube, only on vimeo
-
EdSavoie_srv
his channel is up though, could they be unlisted?
-
pabs
perhaps
-
pabs
I did read about them making lots of videos unlisted recently
-
EdSavoie_srv
something something "a fate worse than death" er, deletion
-
somerando3
-
somerando3
Wouldn't the metadata from something like podchaster be derived from the rthk RSS, so it's suffer the same truncation issues? Going to the article pages in the wayback machine seems like a good idea, if they exist.
-
somerando3
oh and fyi I have 125GB of open line open view and 43GB of backchat mp3s/m4as. I don't have the most upload bandwidth/data cap, and there may be (not large) gaps. If it's needed I can upload somewhere. The RTHK archive server is not the fastest to download from.
-
JAA
Hah, we tried to archive SketchFab's URL shortener through URLTeam a long while ago. They weren't very happy at the time.
-
nyany
JAA: no, they were not...
-
nyany
also, OrIdow6 sure is broken
-
billy549
<billy549> how would one accurately make WARC(s) of an entire site assuming it needs a login cookie?
-
billy549
since i posted in last channel before, ty JAA
-
ivan
-
ivan
accuracy, though... YMMV
-
billy549
ty; what's the best way to open a WARC, fwiw?
-
Jake
-
JAA
pywb works pretty well for local playback.
-
h2ibot
AK edited Hong Kong media (+62, Jobs in progress and done):
wiki.archiveteam.org/?diff=47000&oldid=46993
-
thuban
somerando3: tried some guesses of my own, no luck either :(
-
thuban
as for the truncation issue, probably, yes, but it's worth checking out. unfortunately i don't think we're going to have much luck with the episode pages--rthk's current setup seems to take them down as soon as they scroll off the 1000-ep backlog, wbm coverage is super spotty (~50 results for this podcast), and pre-2017 they may not have existed at all
-
thuban
i have also downloaded stuff and will get it on ia eventually, but i can ping you if i find any issues
-
balrog
did viewing archived tweets on Wayback break?
-
Jake
I believe some old tweets on twitter had bad captures?