-
pabsRetrocomputing Archive retroarchive.org news.ycombinator.com/item?id=28019713
-
jamespRemember INTERNETARCHIVE.BAK? It went on Hiatus and it still says to go on EFnet.
-
jamespWhy did we put some projects on Hiatus when some people really want us to work on some of those projects? One guy on reddit even wanted us to back up a specific twitter account
-
AKBecause there isn't always the capacity to do every project at once
-
AKEveryone here volunteers, and there isn't always time or enough compute power to do it all
-
AKAT tried to prioritize stuff which is about to be lost
-
HCrossjamesp: feel free to push code if you care about the project
-
HCrossat the moment our focus is on priorities of getting content that is about to be lost
-
EggplantNWe always welcome additional contributions. Please submit a PR if you have changes and we can look into them when we have time. We are all volunteers, lots of us have 9-5 jobs, some of us have university and we don’t always have time to do everything. IA.BAK was resumed briefly but not sure it’s status anymore. jamesp
-
jamespokay
-
Kazturning up late here but yeah, IA.BAK had some pretty significant implementation issues and it's not really 'on hiatus' its just in a state where any sort of usage will require a completely rethink of how it's going to work
-
KazSomething like IPFS may be viable, but everything has its drawbacks
-
jamespKaz: My solution is we work directly with the Internet Archive on how we should do it. And what are the Drawbacks of IPFS?
-
JAA→ #internetarchive.bak
-
kpcyrdJAA: is there tooling to to run something like a reverse proxy for http that records requests and responses as warc?
-
[42]kpcyrd: wouldn't that make more sense as a forward proxy?
-
EggplantNthis kpcyrd ? github.com/internetarchive/warcprox
-
kpcyrdthat should work, thanks
-
JAAYep, warcprox is the way.
-
kpcyrdI'm trying to "snapshot" data pulled from mirrors by scripts, basically being able to switch between "record" and "serve" and I only store the data that is actually needed