-
h2ibot
Hayley edited Alive... OR ARE THEY (+54, /* Alarm */ +1):
wiki.archiveteam.org/?diff=50064&oldid=49567
-
h2ibot
-
h2ibot
-
h2ibot
-
h2ibot
-
h2ibot
-
h2ibot
PaulWise edited Mailman2 (+87, couple of potential instances, might be down):
wiki.archiveteam.org/?diff=50070&oldid=50034
-
h2ibot
FireonLive edited ЯRUS (+188, add link to source & tracker, mark as in progress):
wiki.archiveteam.org/?diff=50071&oldid=50061
-
h2ibot
FireonLive edited Current Projects (+120, add ЯRUS):
wiki.archiveteam.org/?diff=50072&oldid=50059
-
h2ibot
FireonLive edited ЯRUS (+195, something better than a blank page):
wiki.archiveteam.org/?diff=50073&oldid=50071
-
h2ibot
FireonLive edited ЯRUS (+34, add references section, oops):
wiki.archiveteam.org/?diff=50074&oldid=50073
-
arkiver
thanks for keeping the wiki up to date fireonlive :)
-
fireonlive
:)
-
h2ibot
-
fireonlive
-
yzqzss|m
fireonlive: This is @difan 's site.
-
yzqzss|m
Some of the dirs are mirrors of www.cn-dos.net (~firststep/, cndos.fam.cx/). Some other files should also be found in a Chinese "old software and CD archives project" (
nuduseng.com/laoguangpan.htm ).
-
yzqzss|m
I have his contact info, do you want me to ask which files are worth archiving?
-
yzqzss|m
(*the server has enough bandwidth to download as many as you want)
-
fireonlive
ah as long as its known to one of you :)
-
fireonlive
i just saw it pop up and was like hmmm better get it over to someone who might know more just in case
-
h2ibot
FireonLive edited Tiki (+966, Add all ArchiveBot jobs (with proper credit…):
wiki.archiveteam.org/?diff=50076&oldid=50056
-
h2ibot
FireonLive edited Deathwatch (+209, add ЯRUS):
wiki.archiveteam.org/?diff=50077&oldid=50058
-
fireonlive
"All Twitter content seems to be behind a login wall today"
masto.ai/@mg/110631881391528778
-
razul
I was just reading Twitter messages an hour ago, now I have the same experience.
-
fireonlive
-
rktk
Nitter uses the official Twitter API I believe, or they do some kind of web scraping
-
rktk
We are T-1 Day away from Reddit API going private, except for if you provide your own API key which I believe is limited to either 60 or 100 requests per minute
-
rktk
at which point you might as well just setup your own Libreddit or teddit instance
-
rktk
*provide your own FREE api key
-
rktk
Nitter uses the *official Twitter app/site API key*
-
rktk
it's mildly shrouded I believe but I recall them saying they would not be affected by the newly announced-back-then paid API rules
-
rktk
I am getting a login wall to access a tweet on normal Twitter.com, canadian home IP
-
testlott
Infowars - the site is on possible bankruptcy and may need help regarding its archives.
-
Megame
arkiver,
anonbin.io going offline tomorrow. Not sure if we did anything with that.
-
Megame
Microsoft Language Portal -
microsoft.com/en-us/language being removed today
-
Megame
Maybe #Y or qwarc?
-
arkiver
Megame: is there much to save for anonbin.io?
-
Ryz
If
old.reddit.com/r/Twitter/comments/1…till_view_twitter_without_having_an is to be believed, and I'm encountering it too, Twitter content is currently login-only
-
rktk
Ryz yes, confirmed myself as well. And seeing a lot of people on the fediverse having the same login prompt
-
nstrom|m
what's with all these last minute shutdown announcements
-
Megame
arkiver, not sure, just saw it on deathwatch
-
rktk
for archiving twitter, nitter instances are the best option now it seems
-
rktk
nstrom|m, the old web is being ripped from our hands with little fanfare.
-
razul
It seems the Reddit drama has sent stuff into motion
-
rktk
i would also theorize that VC funding has dried up given inflation and also people realizing that a lot of stuff just is not worth what was put into it
-
arkiver
two reason: 1. higher interest rates, 2. LLMs
-
rktk
LLMs affecting the web?
-
rktk
in term of content dying?
-
arkiver
platforms mostly lived off ads, paid accounts, private data selling
-
arkiver
they did not have an incentive to make user generated content private
-
arkiver
now there is one - LLMs
-
rktk
Ah, I get it
-
rktk
:(
-
rktk
There are some genuine uses for some of those LLM applications. Not so much the generative ones, but ones that can identify and pull content out of other content.
-
rktk
im not sure how else to describe it
-
razul
Content has become synonym for money even more.
-
myself
rktk: autoplagiarism?
-
rktk
no, like...
-
rktk
like ai voice generators
-
myself
autofraud!
-
rktk
for making funny lines from like, video game characters
-
joepie91|m
"toys"
-
fireonlive
auto gay smut generators
-
fireonlive
i mean uh, homework helpers
-
razul
Anyone using a small low power device you can plug in somewhere and run some warriors on? If so, what are you using?
-
razul
My go to would be a Raspberry Pi, but that's not an option as I understood it.
-
rktk
-
fireonlive
rktk: 🥵
-
fireonlive
also nothing arm as i understand
-
fireonlive
not quite ready/arm isn’t verified to produce 👌🏻 the good soup
-
mgrandi
Can just hardcode a login cookie for archive requests to Twitter
-
rktk
woof. has anyone poked around at doing a vocaroo archive recently?
-
rktk
mgrandi, that requires a twitter account, which often requires a phone number verification
-
fireonlive
you could pull a nitter i guess
-
fireonlive
what’s up with vocaroo?
-
mgrandi
Apparently the embed functionality works, but given from all the spam I get from people on telegram, a phone number is not great security
-
rktk
fireonlive, nothing but it just seems like it's something that's next to go
-
rktk
it's been online since 2007 and there's all sorts of tiny bits of data floating around the net, that could be lost, if it went
-
rktk
ties in to 4chan threads often, too
-
rktk
mgrandi, no a phone number is not good security. rather twitter wants to make signing up for a new account harder
-
rktk
but given there's quite literally billions of available phone numbers in the world, and so many online services that automate for verification... it's useless
-
rktk
nitter is the way to go forward I feel for twitter archival
-
mgrandi
What does nitter do to get past twitter 's lack of API / phone number verification?
-
rktk
mgrandi, as mentioned above most likely using the official twitter in-house API key/access
-
rktk
that is my guess, based on a previous discussion about them mentioning they are "not affected by the API going paid"
-
rktk
Sorry. im totally wrong. From nitter readme: "Uses Twitter's unofficial API (no rate limits or developer account required)"
-
fireonlive
an ok
-
fireonlive
ah*
-
rktk
-
rktk
it seems though this change HAS affected Nitter, but on accounts rather than tweets as a whole
-
fireonlive
uhoh
-
rktk
*shrug* at this point
-
rktk
im just blowing guesses all over tbh
-
arkiver
hello
-
fireonlive
hi
-
arkiver
got interesting information on twitter? PM me! don't dump it in a publicly logged channel
-
fireonlive
do we need an #archiveteam-afterdark for an unlogged option haha
-
myself
razul: I've got a UDOO x86 over here that I was planning on running warriors on, but I'm evidently too dumb for docker. Made a nice mount for it because I'm not too dumb for fusion 360 though :D So in the meantime I'm still just running VMs on my laptop.
-
myself
fireonlive: nah as soon as you say "please don't log this public channel", someone figures there must be a reason why, and logs it.
-
fireonlive
true
-
that_lurker
-
JAA
Personal/private logs aren't the issue. Some of our channels (including this one) have public logs, which can be read by anyone with an internet connection.
-
fireonlive
hm if afterdark is too long it could be -ad as well :p
-
fireonlive
but yeah
-
fireonlive
"say the line, media companies!"
-
fireonlive
"When asked for comment on Monday morning, Twitter promptly responded to NPR's email with a scat symbol."
-
arkiver
literal shit show (i am sure that comment has been made a thousand times)
-
fireonlive
:D
-
arkiver
i'll be off for several hours
-
fireonlive
oki
-
fireonlive
see ya arkiver
-
fireonlive
=]
-
arkiver
:)
-
JAA
That comment will never get old.
-
JAA
Neither will the emoji: 💩
-
fireonlive
💩
-
that_lurker
Now comes the question of which version of the 💩 emoji you like the best
emojipedia.org/pile-of-poo
-
fireonlive
always apple's
-
fireonlive
:3
-
fireonlive
i dislike the animated emoji trend, i feel it's taking away what i'm trying to convey most of the time
-
fireonlive
especially on telegram
-
that_lurker
-
that_lurker
yeah animated ones are wierd
-
JAA
The flies are a nice touch though.
-
fireonlive
it is a nice sticker
-
razul
myself: I'll buy myself some HP prodesk minipc's I think, for 125 euros per piece here, with some good specs. In fact, I'm going to pick some up now.
-
fireonlive
oh that's nice of you to buy myself some gear
-
Doranwen
fireonlive: All of Apple's emojis are superior to all others. Which is kind of funny, because I despise Macs and working on their products. But their emojis are the only tolerable ones to me. The rest are flat ugly things that ought to be burned up, lol.
-
Doranwen
I wonder if the Twitter login wall will affect the fandom people I know saving Twitter fic. Some are just copy/pasting anyway, but I know some attempts were made to use more automated tools.
-
mgrandi
Small scale archiving can probably be fixed with just using your own account's login
-
Doranwen
Yeah, I suspect they're doing that.
-
» Doranwen doesn't have a Twitter account and doesn't plan on getting one, but has never been involved in saving stuff from there other than the occasional video.
-
h2ibot
JustAnotherArchivist edited Deathwatch (+0, /* 2023 */ Fix ЯRUS link):
wiki.archiveteam.org/?diff=50078&oldid=50077
-
fireonlive
whoops
-
fireonlive
"June 30: Template:ЯRUS, a Rus" lol
-
fireonlive
🤦♂️
-
JAA
It happens, I've done the same thing before but worse. :-P
-
fireonlive
x3
-
JAA
Mine included the namespace, so it would've actually transcluded the page.
-
fireonlive
oops
-
JAA
Oops
-
JAA
Fortunately, the target page didn't exist at the time. :-)
-
fireonlive
i tried to make ArchiveBot linkable last night in Template:Infobox_project like DPoS is
-
fireonlive
then i was like i'm not ready for this level of wikitext
-
fireonlive
especially at this time of night lol
-
fireonlive
s/linkable/a link to [[ArchiveBot]]/
-
fireonlive
oh good :3
-
JAA
Oh, I thought AB was linked.
-
JAA
But yeah, that template is fun.
-
fireonlive
doesn't seem to be
-
fireonlive
yeah haha
-
JAA
{{ #ifeq: {{#replace:{{#replace:{{#replace:{{#replace:, ...
-
fireonlive
i opened it up and was like huh ok lets see... tried a couple things with 'show changes' and was like ok not tonight
-
fireonlive
yeah xD
-
h2ibot
JustAnotherArchivist edited Template:Infobox project (+39, Link ArchiveBot in 'Archiving type' row):
wiki.archiveteam.org/?diff=50079&oldid=48916
-
h2ibot
-
fireonlive
ahh i see
-
fireonlive
thanks JAA :D
-
JAA
:-)
-
JAA
Also took me a minute to wrap my head around it again.
-
fireonlive
haha i bet
-
fireonlive
not necessarily archiveteam; but was there ever a pornhub archive/backup before "the great purgening"?
-
kiska
Not to my knowledge
-
h2ibot
Entartet edited Twitter (+202, Impossible to view tweets without logging into…):
wiki.archiveteam.org/?diff=50081&oldid=49784
-
fireonlive
ah thanks kiska
-
fireonlive
i guess some bookmarks are dust in the wind
-
fireonlive
now i have a pipeline!
-
fireonlive
....
-
fireonlive
the code kind!
-
h2ibot
Entartet edited Twitter (+189, /* Vital Signs */ Decreasing user activity.):
wiki.archiveteam.org/?diff=50082&oldid=50081
-
h2ibot
FireonLive edited Tiki (+15, link to Barto):
wiki.archiveteam.org/?diff=50083&oldid=50076
-
that_lurker
-
Exorcism|m
Nitter is dead too ?
-
-
nulldata
If Elon is to be believed, the Twitter post viewing restrictions are a "temporary" measure against "several hundred organizations" scraping Twitter data "extremely aggressively"
github-production-user-asset-6210df…ba-3c5a-4acb-99ba-2e897fa69cbc.jpeg
-
nulldata
-
fireonlive
....
-
fireonlive
hm.
-
Barto
lol, so he blocks everyone, even residential ips? They really couldn't figure out the pattern of those orgs or propose them an official contract?
-
nicolas17
that's stupid
-
nicolas17
the "scraping orgs" can just set googlebot as their user agent and continue
-
nicolas17
or WhatsApp/2.0
-
nicolas17
unless he broke that as well now :P
-
nicolas17
ok this is returning 404 now: curl -v -A "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +
google.com/bot.html) Chrome/113.0.5672.127 Safari/537.36"
twitter.com/elonmusk/status/1674887204580073474
-
Barto
nicolas17: it's like the war on drugs, because you weaponize defense, the only answer is for everyone else to weaponize in response. Now the organization will start to obfuscate their traffic and you'll see jack shit in the logs. Congratz.
-
Barto
and next time you have an issue? You're screwed
-
nicolas17
it seems they actually broke googlebot now
-
Barto
lol, even better
-
fireonlive
please to report any bypases etc you find to arkiver directly and not in #archiveteam or here (or any publicly logged channel)
-
fireonlive
(as per arkiver's request)
-
fireonlive
(those got fucked though)
-
nicolas17
the bypasses I knew (googlebot and whatsapp) were publicly posted on twitter itself
-
fireonlive
ye just to keep in mind for future :3
-
masterX244
googlebot is easy to verify by a IP lookup though, they document it somewhere on how to verify
-
fireonlive
should you find ?elon_mode=1 or something
-
fireonlive
they do indeed
-
nicolas17
scrape via google translate /s
-
fireonlive
("Elon mode": supposedly a secret mode in Tesla self driving which bypassed some of the safety stuff including requiring the "hands on the wheel every so often" for autopilot)
-
fireonlive
:3
-
Barto
right now i doubt twitter even has a steering wheel
-
nicolas17
-
Barto
i don't have a twitter account mate :D
-
fireonlive
please hold
-
Barto
i had a way to read them 2 hours ago, but it broke as well
-
pokechu22
-
fireonlive
there ya go
-
pokechu22
I'm pretty sure archive.vn uses a logged in account though (they do for github at least)
-
Barto
that second link works
-
fireonlive
it does yeah
-
Barto
so yeah, that's what twitter has become
-
nicolas17
wow google translate is broken too
-
nicolas17
-
fireonlive
'ERR_TOO_MANY_ACCEPT_CH_RESTARTS'
-
fireonlive
huh
-
nicolas17
it redirects to /home over and over
-
fireonlive
mm, never seen _CH_RESTARTS before
-
fireonlive
-
fireonlive
it's exploding on hacker news somewhat
-
nicolas17