-
pokechu22
arkiver: re your AB job on
poemlife.com, when is it shutting down? It needs to be run slowly due to rate limiting on the site and I'm wondering if I should add an ignore for links to individual posts - as it stands, it'd take somewhere between 2 weeks and a month to finish the current queue
-
IDK
-
IDK
nvm
-
h2ibot
Bzc6p edited Network.hu (+17, If you look closely, there's already a pretty…):
wiki.archiveteam.org/?diff=50280&oldid=50227
-
h2ibot
Bzc6p edited Network.hu (+280, More clarification and update):
wiki.archiveteam.org/?diff=50281&oldid=50280
-
h2ibot
-
h2ibot
-
h2ibot
PaulWise edited Google Drive (+0, fix link):
wiki.archiveteam.org/?diff=50284&oldid=50278
-
fireonlive
-
fireonlive
hold on to your buttholes
-
rewby
Yep, that's gonna end badly
-
arkiver
IDK: do you have a web page example on which those weheartit images are embedded?
-
imer
all links of ddg/google I could find just redirect to the main page
-
imer
might just be gone?
-
imer
This URL has been excluded from the Wayback Machine. lovely
-
FavoritoHJS
considering how increasingly desperate youtube is for money... i fear a 144p archive project should be planned
-
DogsRNice
what do you mean
-
fireonlive
hmm?
-
FavoritoHJS
basically, yt is cutting off ad blockers, trying to make youtubers pay for their own advertising, in general signs of "site out of money" desperation
-
JAA
And you're going to pay for it? Cool. :-)
-
DogsRNice
i feel like 144p content is the least at risk, ive noticed they seem to automatically load some videos in lower resolution more often, probably to save on bandwidth
-
pokechu22
I think the point is more that saving everything at 144p is more feasible than saving everything in HD, not that 144p is going away
-
FavoritoHJS
this, good luck having enough storage to store everything at the highest quality
-
FavoritoHJS
but 144p should be enough to know something was there, and confirm that an external archive is (probably) correct
-
DogsRNice
that makes more sense
-
FavoritoHJS
still would be huge, though
-
FavoritoHJS
*HUGE
-
fireonlive
pay for their own advertising?
-
JAA
Even at 144p, you're still looking at a couple dozen petabytes probably.
-
fireonlive
how about 72p
-
fireonlive
:d
-
FavoritoHJS
i suspect diminishing returns would strike
-
FavoritoHJS
even 144p might be well beyond diminishing returns over a similarly low-bitrate 240p...
-
FavoritoHJS
which means we will need dozens of petabytes of storage. not happening anytime soon
-
JAA
Correct, and by the time we can easily get that, it'll have grown by an order of magnitude.
-
FavoritoHJS
about that... sure, storing videos at native quality WOULD probably have grown by that point, but i doubt the number of videos will grow exponentially
-
FavoritoHJS
not anymore, at least
-
IDK
arkiver: moving from #archiveteam
-
DigitalDragons
just need some billionaires to throw some of the money that's clearly burning a hole in their pocket at archive.org
-
Barto
fireonlive: just the audio :D Metadata would be cool
-
fireonlive
true :3
-
JAA
I'm curious how large the audio would be. Certainly still more than SoundCloud at a couple petabytes.
-
fireonlive
metadata + maybe hashsums? at the most i guess
-
JAA
Audio bitrates aren't much lower than 144p video, so I guess the estimate from above is still about right.
-
fireonlive
but.. i don't think those are natively provided
-
fireonlive
so that'd be a looooot of data to chew through to provide a sha256 hash or something lol
-
fireonlive
(then it's like, per every format? which formats?)
-
JAA
And then YouTube reencodes the video and the hashes get fucked.
-
fireonlive
that too :D
-
fireonlive
VP10 gets released in 20XX, eveything gets re-transcoded...
-
DigitalDragons
isn't av1 coming #soon(tm)
-
fireonlive
we can hope!
-
JAA
They have AV1, but only on some videos.
-
fireonlive
here's all the formats for that recent redit video
bpa.st/QRCWZZPFV3VU7UPPNA3IW7X2SE
-
fireonlive
ahh ok
-
JAA
-
fireonlive
:)
-
fireonlive
let's see what -vF shows for the oliveer video
-
fireonlive
-
fireonlive
ah ok
-
fireonlive
the storyboard .mhtml is interesting
-
fireonlive
?! ping timeout on my end i guess?
-
fireonlive
bpa.st/L7JIX7NU2TRCGYC4VE7H5NNXWM < the storyboard .mhtml is interesting lol, never downlaoded it before
-
fireonlive
i see av01 in there though
-
qwertyasdfuiopghjkl
I'm guessing even a DPoS project couldn't keep up with downloading everything being uploaded to YT just to calculate the hashes of the videos and throw them away, even if there were no ratelimits (and it'd definitely not be worth it). All metadata sounds a lot less impossible and once we have it it would be possible to do more targeted video grabs
-
qwertyasdfuiopghjkl
such as (for example) archiving videos uploaded before a specific year, when YouTube and file sizes were a lot smaller.
-
flashfire42
qwertyasdfuiopghjkl it would but where the fuck would we put it all.
-
qwertyasdfuiopghjkl
I assume the 1st year of YT at 144p might be possible, but I haven't done any calculations so my guess might be off by a huge amount.