-
pabs
-
pabs
woops, already posted
-
pabs
if I have a list of URLs to a single site that I want to run in AB via !a commands, can h2ibot run those and ensure that there is always only one job to that site running?
-
pabs
or do I need to hack around in my IRC client's scripting for that?
-
thuban
pabs: i think you're looking for queueh2ibot, but i don't know how to operate it. JAA?
-
pabs
-
pabs
I think the main AB job for the domain isn't going to find these, so I went search engine spelunking
-
thuban
(although, hmm, i think it normally limits the total number of jobs--not sure if it can limit by site)
-
pabs
yep, the main AB job definitely missed them all
-
project10
OK, wild suggestion, but hear me out: what if we just stored everything in IPFS?
-
project10
I owe arkiver $1
-
arkiver
woah! problem solved!
-
arkiver
rewby: ^ project10 found the solution to storage problems
-
fireonlive
🤯
-
fireonlive
it's perfect!
-
project10
more than perfect, it's inter-planetary
-
arkiver
*mind blown*
-
fireonlive
absolutely!
-
fireonlive
we were fools for not thinking about this before!
-
fireonlive
IPFS++
-
eggdrop
[karma] 'IPFS' is now at 1
-
shinji257
nicolas17: For a bit Windows 11 was updating AMD drivers with "newer" versions even when the option was disabled and installed via external means. This caused a headache and a mismatch between the driver version and AMD Adrenaline software. You could quickly workaround it by doing a rollback but still annoying.
-
DigitalDragons
IPFS++
-
eggdrop
[karma] 'IPFS' is now at 2
-
DigitalDragons
crypto is the way
-
project10
when you all get rich I'll accept donations via buttcoin
-
DigitalDragons
wdym we're making archivecoin
-
arkiver
Archive Team coin /s
-
fireonlive
holy shit arkiver
-
fireonlive
you're on to something there
-
fireonlive
ICO when???
-
fireonlive
eta?
-
fireonlive
arkiver: eta?
-
arkiver
every item archived is a coin ;) so go archive those items
-
project10
it'd never work, AT couldn't resist backing up the wallet.dat to IA
-
arkiver
:P
-
fireonlive
true...
-
arkiver
there has been a scam group at one point claiming some coin in cooperation with Archive Team i believe. long time ago, don't remember the details
-
fireonlive
there must be a way we can blockchain this
-
project10
Our new coin, based on Proof of Distributed Preservation of Service, PoDPoS
-
fireonlive
yes!
-
DigitalDragons
arkiver: that's amazing lol
-
fireonlive
we need to get some NFTs going as well
-
project10
connected to the folks with the Archive Team sticker?
-
fireonlive
absolutely!
-
TheTechRobo
Let's sell NFTs of the Archive Team Warrior logo
-
DigitalDragons
no no no you're thinking too simple
-
TheTechRobo
And then you get higher spots on the leaderboard
-
DigitalDragons
i'll spin up chat gpt and get it to feed paragraphs of text into stable diffusion
-
DigitalDragons
and then those are our nfts
-
arkiver
DigitalDragons: i can't immediately find the details unfortunately
-
fireonlive
we'll feed that_lurker's memes into a machine lurning model and use it to pump out NFTs
-
TheTechRobo
xD
-
DigitalDragons
fireonlive: not enough training data, spin up a billion ec2 instances to scrape archive.org for the rest
-
fireonlive
ah yes
-
fireonlive
we'll be sure to also use residential proxies too
-
DigitalDragons
who cares if it crashes ¯\_(ツ)_/¯ /s
-
TheTechRobo
IA's been running so smoothly the past few months, we have to liven things up somehow
-
arkiver
lol
-
nulldata
Do we really want to limit ourselves to just planets? Cosmic File System ftw
-
DigitalDragons
TheTechRobo: I think I'm seeing "total_tasks_queued exceeds global_limit" in my dreams
-
TheTechRobo
you only hit the global limit? amateur
-
TheTechRobo
i, like a real man, hit *both* the global and per-item limits awhile back
-
DigitalDragons
I'm working on it
-
TheTechRobo
-
fireonlive
your 40,000 distributed 300PiB gay porn backup accounts haven't been banned and content purged yet?
-
fireonlive
smh
-
TheTechRobo
you know IA wasn't doing well because that screenshot was taken when #burnthetwitch had 1 concurrent total
-
arkiver
things are getting a tiny bit better
-
arkiver
but it'll still take some time
-
fireonlive
i have a song for this
-
fireonlive
-
fireonlive
arkiver: 🎵
-
fireonlive
ohh, "waiting for your *call*"
-
project10
-
immibis
You're all missing the obvious solution: every collection and item should be an NFT
-
arkiver
fireonlive: yeah that fits :P
-
fireonlive
:D
-
Exorcism
<TheTechRobo> "
lounge.thetechrobo.ca..." <- oopsie 🤭
-
that_lurker
Woke up, got to work and opened irc. Noticed someone mentioned me. Scrolled up.... Word I did not expect to read today where meme, machine learning and NFT :P
-
fireonlive
:D
-
vokunal|m
I just checked in for the first time today before heading to bed, and apparently I wasn't notified today was opposite day
-
plcp
pokechu22: it's effective
-
plcp
oranges pages-persos are up again
-
plcp
its unofficial and will last until the 30th of september
-
plcp
(cc thuban & fireonlive maybe)
-
TheTechRobo
arkiver: ^
-
plcp
I've resumed my own mirroring of the pagespersos and it looks like its indeed back, getting a lot of 200 ok & stuff
-
JAA
thuban, pabs: queueh2ibot doesn't have an interface, it's just a script I run to send a list of commands to the channel slowly.
-
JAA
pabs: I don't think we need queueh2ibot for this one. An !a < job will suffice after removing the trailing slashes.
-
JAA
Yep, there was an Ethereum scam about AT a couple years ago. I don't remember the details either apart from that I posted an announcement on /r/Archiveteam about it.
-
JAA
This was in early October 2020 if someone wants to dig around.
-
JAA
-
plcp
pages.perso.orange.fr prolonged until the 5th of october \ô/ \ô/ \ô/
-
arkiver
plcp: wooh!
-
arkiver
time to get something going
-
plcp
its official now
-
pabs
hmm, just today I found an orage URL in search results and it redirected to the ending announcement
-
plcp
this morning it was still down, during lunch time too, but visibly they turned the lights back on afterwards
-
pabs
hmm, the "Gérer vos sites" link there gives me a 403 after captcha
-
pabs
ah, thats for people with a login
-
pabs
wishful thinking, thought they might have published a URL list
-
pabs
I do notice some sites have a HTML notice redirecting from one perso subdomain to another:
wangchu.perso.orange.fr says it is at
wangchu.pagesperso-orange.fr instead
-
AntoninDelFabbro|m
We talked about this before
-
AntoninDelFabbro|m
> <@antonindelfabbro:tedomum.net> Also, an history, from as far as I know:... (full message at <
matrix.hackint.org/_matrix/media/v3…ackint.org/tKZDXpJleHlMwsZDKDzCoeAL>)
-
plcp
its a complete mess, on my side, I added a local reverse proxy to rewrite these dead links (and there are many other edge cases with old legacy URLs that never got a proper 302)
-
plcp
yeah AntoninDelFabbro|m got it right
-
AntoninDelFabbro|m
That's Orange. It's years of mess above years of mess—what a mess
-
Ryz
-
Ryz
Basically starting on 2024 January, game devs/publishers have to pay a minute fee on each user/player installation that uses the Unity engine
-
Ryz
...Inb4 archiving more and more of Unity?
-
kiryu
Well it's always the coporate greed that causes trouble . . .
-
arkiver
short term money squeezing
-
arkiver
long term company destruction
-
JAA
What is this 'long term' thing you're speaking of? Next quarter?
-
arkiver
few years probably
-
Ryz
This not only applies to games released since 2024 January, but also games before it too, retroactively
-
fireonlive
all that matters is the Qs 😎
-
arkiver
Qs?
-
Ryz
So...time to figure out how to archive Unity video games even more :c
-
Ryz
Especially the countless free games out there ;-;
-
Ryz
Itch.io being one example~
-
JAA
Cute, arkiver thinks these managers are able to think a few years ahead. :-)
-
fireonlive
quarters, profits :(
-
fireonlive
“short term”
-
DigitalDragons
but the shareholders!
-
fireonlive
*buys one share* i demand better!
-
arkiver
JAA: many can't, hence long term destruction
-
» fireonlive gives arkiver a coffee
-
arkiver
?
-
arkiver
maybe i'm not understanding something :P
-
JAA
Read my first comment again in manager voice. :-P
-
Exorcism
I allow myself to post this
-
-
JAA
Yeah, paid platform with no publicly accessible content. Not in scope for AT.
-
imer
re: unity thing, the "sneaky" change of no more plus plan is more annoying for tiny devs imo, can't hide the unity splash screen (the mark of bad games :p) anymore unless you pay them 2k a year
-
thuban
so what's the plan on re-tackling orange? arkiver, you mentioned an emergency project before it went down; is that still on the table, or are we just going to try to pick up archivebot where it left off?
-
pokechu22
I don't think there's any super intelligent way of resuming the AB jobs, other than using information about what sites existed and what sites didn't (which would still speed things up). We do have databases and logs for the aborted jobs so that does allow resuming and redoing some stuff, but there's not a super elegant way of doing it
-
thuban
yeah
-
thuban
i think in principle there's probably enough time and enough data to cover everything through archivebot, but it would involve enough manual fiddling that i'd trust a distributed project more
-
JAA
that_lurker: See 15:48
-
that_lurker
yeah should have noticed that first
-
joepie91|m
re: viaplay, they are in financial trouble; yearly subscriptions are stopped in NL, price increases are expected (after another price increase a couple months ago)
-
that_lurker
yeah they will most likely end up being in "lifesupport" by operating only in Norway, Sweden, Finland and Estonia regions
-
joepie91|m
but yeah, I also don't see what there is for AT to do
-
joepie91|m
Ryz: regarding Unity, do we know whether this fee will be retroactively applied to already-published Unity games?
-
JAA
> the fee applies to eligible games currently in market that continue to distribute the runtime.
-
JAA
-
shinji257
Ouch
-
joepie91|m
well, fuck.
-
joepie91|m
I expect a massacre on itch.io then
-
joepie91|m
oh wait no
-
JAA
Most of those probably don't have enough revenue, I'd guess?
-
joepie91|m
> Please note: It is important to remember that games that do not reach the revenue threshold, including games that are not monetized in any way, are not required to pay the per-install fee.
-
joepie91|m
phew
-
joepie91|m
it's specifically the free games I was worried about
-
joepie91|m
but those are exempt
-
JAA
Right
-
shinji257
Oh ok. So games that are released for free or < $200k in a 12 month rolling period can remove the Unity splash and not incur any additional fees as well?
-
joepie91|m
another concern is that this is going to interact poorly with pirated games
-
shinji257
*$200k earned
-
joepie91|m
because if the analytics snitching code isn't hacked out of it in the pirated release...
-
joepie91|m
shinji257: I don't know about the splash
-
imer
splash is still bound to the license afaik, so gotta pay for pro now since plus isnt a thing anymore
-
shinji257
So you still have to pay that $2k/yr even if you don't sell anything just so you can remove the splash.
-
imer
as far as I understand, yup
-
imer
my main annoyance with the change (personally), but the pay-per-install could break your neck too depending on the game/revenue model
-
shinji257
Yup
-
nicolas17
-
eggdrop
-
imer
yep, great stuff :D
-
Barto
Time to switch to godot i guess
-
Barto
i mean, that's even a greater outcome
-
imer
-
eggdrop
-
imer
how to bankrupt any gaming company using unity in 3 steps: download game, delete game, repeat
-
fireonlive
lol
-
fireonlive
-
nicolas17
-
DigitalDragons
"Sorry! You've reached the maximum number of installs for this game. Please purchase more from our online store to continue playing."
-
JAA
imer: And if you hold a grudge against a particular company, reverse-engineer the Unity install tracking ping, then hammer that.
-
fireonlive
oh my god
-
fireonlive
JAA++
-
eggdrop
[karma] 'JAA' is now at 2
-
fireonlive
that's so evil i love it
-
Rootliam
Ok so I was here like a week ago asking about the yahoo video archives
-
fireonlive
hi!
-
Rootliam
And since then I have taken on indexing them all by myself
-
Rootliam
but anyway i'd just like to note that this one
archive.org/details/ARCHIVETEAM-YV-003100001-003199999 is actually a mislabeled friendster archive lmao
-
fireonlive
hm it has files like '1/1/3116957/photos/75/96/3116957/0_722428468.jpg'
-
fireonlive
interesting yeah
-
fireonlive
cc arkiver
-
fireonlive
from a wget.log: 2011-05-09 23:39:05 URL:http://profiles.friendster.com/3111729 [26926] -> "data/3/1/1/3111729/profile.html" [1]
-
fireonlive
Rootliam: thanks for letting us know!
-
nicolas17
Rootliam: oh I'm indexing them too :P
-
nicolas17
I did the .tar.bz2 first because those *have* to be fully downloaded
-
nicolas17
plan was that while those were downloading and indexing, I could make a script to do .tar faster, by skipping over the file contents
-
nicolas17
but I finished with all .tar.bz2 and still didn't get around to *starting* said script, so downloading those fully too :P
-
fireonlive
collaborate: initiate!
-
flashfire42
where are you guys seeing all the stat pages of how on fire IA is at any given time?
-
Rootliam
Does the program you're using output the raw locations of the files in the tar nicolas17
-
Rootliam
Cause I did all the bz2/xz ones too with my own program that does, and similarly I was planning on adding libcurl support to skip downloading the whole file
-
nicolas17
Rootliam: isn't that useless for bz2? you can't seek to arbitrary locations in the tar if it's compressed
-
Terbium
-
Rootliam
Yeah but I wanted to know what's in them, really they should probably be reuploaded uncompressed they're not much bigger
-
nicolas17
yeah I mean specifically "having the raw locations" seems pointless for .bz2 :)
-
h2ibot
Usernam edited List of websites excluded from the Wayback Machine (+22):
wiki.archiveteam.org/?diff=50765&oldid=50754
-
Rootliam
nicolas17: So would you like me to upload my program (exports index/positions and all the HTML files) once it can run entirely through libcurl/range requests? We could split the remaining archives and upload the data for anyone who wants to build a search engine out of it
-
nicolas17
looks like I have 48 out of 158
-
fireonlive
apropos of almost nothing, but i was clicking around on fart the other day or two and found there were indexes made for justintv/twitchtv?
archive.fart.website/archiveteam
-
fireonlive
...JAA had one made for.... something where the WBM had issues with case sensitivity too I believe
-
Michael
Hello!
-
Michael
Is anyone online atm?
-
pokechu22
Yes
-
Michael
I was wondering if anyone had a copy of a certain page from a certain time period.
-
Michael
Specifically a game's steam greenlight page
-
Michael
i'm not really sure where people keep this stuff, i'm only asking just incase it exists
-
pokechu22
If we do, it'd be on
web.archive.org as most archiveteam stuff ends up there
-
Michael
do you know of a specific link? I'm not good at finding things.
-
pokechu22
If you've got the link for the current game page or what it would have been in the past, you can plug it in to the big field on the front page (or manually enter a URL like
web.archive.org/*/example.com)
-
Michael
I have. it flat out isn't there. or rather, what specific year/day i'm looking for isn't.
-
Michael
I'm asking because i'm looking for a specific video
-
Michael
that was actually ON
-
Michael
a steam greenlight page that's now gone.
-
Michael
(yes I looked, it's impossible to find in my eyes.)
-
pokechu22
Can you link to the game page? I can try a few things that are a bit odd to explain
-
Michael
I would ask if anyone over at the wayback archive staff would happen to know if it was somewhere or not, but i'm really shy.
-
Michael
-
Michael
it's this specific version of the page that has an old video
-
Michael
I can provide the actual video ID if you want
-
pokechu22
ah, the video is embedded from
web.archive.org/web/20170915084413o…=1&enablejsapi=1&playerapiid=133558 it seems (based on my browser dev tools)
-
pokechu22
-
nicolas17
oh it uses youtube?
-
Michael
yup, that's the video!
-
pokechu22
Seems like it uses youtube but also embeds it as a flash video back then
-
Michael
would anyone happen to have it archived somewhere?
-
Michael
finding this thing would be like
-
pokechu22
-
Michael
are there any like, mirrors somewhere?
-
Michael
i'm not the guy who does tech stuff sadly
-
Michael
(i wish to be a nerd soon...)
-
pokechu22
YouTube is one of the archiveteam projects that does have data that's not on web.archive.org - I don't remember entirely how that works but someone else here should know
-
pokechu22
I'm not sure if they'd have something from 2012 though
-
nicolas17
Michael: if we archived every single youtube video found embedded on a website, internet archive would run out of disk space quick :P
-
Michael
I know, space is finite
-
Michael
i'm just crossing my fingers someone decided to inexplicably back it up.
-
nicolas17
youtube is just unimaginably large
-
nicolas17
archiving youtube also needs special tools, so I think whatever wayback machine does on its own to crawl generic websites won't do it
-
pokechu22
The other project is #youtubearchive (see
borg.xyz/ya.htm) but it doesn't seem like they have it archived
-
pokechu22
IA does have some captures for random old youtube videos, even from back in 2012, but not this one it seems :|
-
Michael
I actually had an entire LIST of videos I was trying to find but wanted to only stick to one since I didn't wanna sound rude or anything.
-
Michael
specifically a list of Youtube IDs
-
Michael
some ranging from 2012 to 2013
-
pokechu22
-
Michael
that exists?
-
Michael
thanks!
-
Michael
Wait
-
Michael
I think i've talked to you before
-
pokechu22
I checked that specific one and it didn't exist in the channel, but other ones I did find
-
pokechu22
err
-
Michael
wait what
-
pokechu22
I have no idea why I typed "but other ones I did find", that's not true at all
-
pokechu22
not really thinking :|
-
pokechu22
I don't think I've actually successfully searched for stuff in there before, not super experienced with the project
-
flashfire42
-
flashfire42
try that
-
TheTechRobo
good evening hello
-
Michael
hope you're doing good
-
Michael
Yeah, a site like that seems good.
-
Michael
Are there any others?
-
TheTechRobo
that one ideally should have every decent youtube archive, so if you _do_ know of any others, let me know
-
Michael
the stuff i'm looking for is one none of these sites sadly.
-
Michael
Except for Metadata.
-
arkiver
thuban: pokechu22: keeping it running in AB will not hurt
-
arkiver
Rootliam: fireonlive: ah i see :/
-
arkiver
we won't rename the item though
-
JAA
fireonlive: I made one for picosong, yeah. There have also been a couple more.
-
fireonlive
ah right!
-
fireonlive
arkiver: can it be moved to the friendster collection perhaps?
-
fireonlive
find its lost brothers or something
-
Michael
Yeah, I plugged in most of these IDs, and none of them were archived.
-
fireonlive
entropy did not favour you this time i suppose
-
Michael
I was there was somehow another potential way to get these but I guess they're truly lost.
-
pokechu22
Have you tried emailing the hat in time developers?
-
Rootliam
arkiver: Is there possibly part of the YV archives that is actually missing due to this name mixup?
-
Michael
Yeah, the developers purged them a long time ago. The videos I mean.
-
Michael
It's lost media to even THEM.
-
fireonlive
i’d quote someone here but i’ll leave that nest