-
Fusl_
tracker is fixed again, sorry for the trouble
-
Fusl_
blame fionera for absolutely no reason, thanks
-
fionera
lol
-
JAA
tech234a: Thanks for the edits. I've been wondering about this. We should probably just switch Template:IRC to default to hackint since we don't have anything on EFnet anymore. Only downside is that it'll change the old project pages as well, but those channels are dead anyway.
-
tech234a
Yeah it looks like everything that's active has moved at this point right?
-
JAA
Most of the project channels have been over here already for a while anyway.
-
purplebot
1 edits not shown
-
purplebot
Dev/Staging edited by Tech234a (+2, Switch EFnet reference to hackint) just now --
archiveteam.org/?diff=45718&oldid=23598
-
purplebot
Frequently Asked Questions edited by Tech234a (+10, Switch EFnet reference to hackint) just now --
archiveteam.org/?diff=45717&oldid=43524
-
purplebot
ArchiveBot edited by Tech234a (+2, Switch EFnet reference to hackint) just now --
archiveteam.org/?diff=45719&oldid=45661
-
purplebot
ISP Hosting edited by Tech234a (+7, Switch EFnet reference to hackint) just now --
archiveteam.org/?diff=45720&oldid=45362
-
purplebot
University Web Hosting edited by Tech234a (-58, Switch EFnet reference to hackint) just now --
archiveteam.org/?diff=45721&oldid=45374
-
tech234a
JAA: is there a page for older projects?... it seems anything left on the homepage on EFNet is old or inactive and this may be a good opportunity to declutter the homepage
-
JAA
tech234a: Yeah, that section isn't being kept up to date at all. :-|
-
JAA
There is another page which is even more out of date.
-
JAA
-
JAA
Well, current ones are in, but everything from 2017 and 2018 is missing.
-
JAA
We could do a better job at documenting things.
-
tech234a
-
purplebot
NewsGrabber edited by Tech234a (+24, Switch EFnet reference to hackint) just now --
archiveteam.org/?diff=45722&oldid=30831
-
purplebot
Current Projects edited by Tech234a (+160, Switch EFnet references to hackint) just now --
archiveteam.org/?diff=45723&oldid=45685
-
OrIdow6
The wiki is like something from fiction - an old building, that people keep adding rooms to, and abandoning the old ones
-
JAA
Sounds like an SCP alright.
-
OrIdow6
Maybe write some sort of script to add the parameter, before the template is changed? Might be hard to find logs or similar otherwise
-
JAA
And yes, very accurate.
-
JAA
Nah, let's not go down that route.
-
JAA
The project channels aren't logged anyway.
-
JAA
(Most of the time)
-
OrIdow6
Oh, I suppose you're right
-
JAA
If noone shouts at me, I'll switch the default later.
-
hook54321
OrIdow6: I could just add it to those manually, I was gonna look into how long it would take anyways. At this point though it might make sense to just remove those channels from pages so people are directed to #archiveteam instead of an empty channel.
-
JAA
I've been wondering whether we should switch the default channel on project pages to -bs also.
-
purplebot
NewsGrabber edited by Hook54321 (+46) 18 minutes ago --
archiveteam.org/?diff=45724&oldid=45722
-
JAA
It's basically never appropriate to talk about existing projects in #archiveteam.
-
thuban
imo it should be something on the order of '#original (defunct, use #archiveteam-bs)'
-
thuban
i'd be willing to help fix the existing pages (i feel like hiding that info and ending up with something misleading is against the at mission :P)
-
JAA
Yeah, I thought the other day about adding a `dead` parameter to the IRC template, which would produce something like that.
-
thuban
(even if project pages aren't logged, it can be helpful for e.g. knowing where in your own logs to check)
-
hook54321
seems unnecessary to me, but eh. people can find it in the revision history, not really hiding.
-
thuban
i think that's a good idea
-
thuban
(s/pages/channels/)
-
JAA
I agree with thuban that it'd be good to keep the original channel name there.
-
JAA
One thing I'd love to see is Semantic MediaWiki or similar where we put everything on the project page and then it places all pages with some category on the homepage, adds them to the 'Warrior projects' page, and possibly other things.
-
JAA
But that's probably too much work for this.
-
thuban
huh, can you not get mediawiki to do that?
-
JAA
Well, the pages themselves yes, but I also mean the IRC channel etc. Not possible with stock MW as far as I know.
-
thuban
ah, i see. pity
-
JAA
Well, I guess you could use <includeonly> and <noinclude>, but that's gross.
-
» Doranwen recommends putting the new version *first* though, if you're going to include both
-
Doranwen
like #archiveteam-bs (formerly #original)
-
Doranwen
put "formerly" in () with the old name
-
Doranwen
the way people think is the current thing should be the first visible one, with the history after that or tucked away somewhere accessible
-
Doranwen
you never want to put the old/defunct thing first, because it confuses people
-
Doranwen
people are notoriously terrible at skimming and picking up the first/main things and missing minor details, and if you stick the old/defunct thing first, there's a much higher probability of someone failing to see the addendum in parentheses noting the new/current one
-
JAA
Yes, good point.
-
JAA
Absolutely.
-
Jean-Fred
mgrandi Macricke from VGPC figured out an awesome trick:
-
mgrandi
Hi, I managed to get some JSON api, which I think is a lot easier to download the info
-
Jean-Fred
for some reason Sony decided to roll out the new design to the mobile app next week (28th October)Archive Team can force the old store by having the crawler pretend to be the mobile app`?scope=sceapp&smcid=psapp`if you append that to the end of the string in the URL field, it will force the old site to loadso Archive Team should be able to capture
-
Jean-Fred
all pages before the 28th[storeURL]/product/[contentID]?smcid=psappstoreURL would be any of the 94 on the list I gave you and contentID would be something like “EP1001-CUSA18100_00-MAFIAONEREMASTER” which is a unique ID given to each and every product listed on the PS Store
-
mgrandi
hmm
-
mgrandi
I think it might need the host key set too, i dunno
-
mgrandi
I don't think scraping the store is going that well, their app seems to be very javascript heavy and i'm noticing that wget-at is not fetching imgaes
-
mgrandi
I don't think scraping the store is going that well, their app seems to be very javascript heavy and i'm noticing that wget-at is not fetching images
-
mgrandi
(sorry, force of habit from teams lol)
-
Jean-Fred
Amazingly iy seems to Just Work −
store.playstation.com/ja-jp/product…D000000001?scope=sceapp&smcid=psapp works but wihtout it does not resolve
-
mgrandi
hmm ok, that might make it easier to get the list of urls
-
mgrandi
so : do you know if the SKUs are region specific? like is JP9000-NPJA00045_00-DETUNED000000001 japan only
-
Jean-Fred
Macricke helped me there to, they said: "there was discussion around how content IDs are linked to store regions e.g. UP0001 for US, EP0001 for Europe, HP0001 for Asia…that’s not strictly the case. There is loads of UP or EP content on the Japanese storefront, for example. So I believe to be safe we’d need to try every possible combination of
-
Jean-Fred
[storeURL] and [contentID] otherwise there’s a risk of missing a bunch of content"
-
mgrandi
so what i'm thinking of doing, is going to each major region's grid page
-
mgrandi
getting a list of SKUs
-
mgrandi
then getting this api called 'valkyrie' to get basic information about the game for each major language: `curl
store.playstation.com/valkyrie-api/…P9000-NPJA00045_00-DETUNED000000001`
-
Jean-Fred
The complete SKU list should be on SerialStation.com in theory − asked the owner for a dump of the SKUs as well ; they told me they might be able to hand me out a script that goes through the API (either the Valkyrie API or the other Chihiro API − I dunno, it’s a bit out my league ^^)
-
mgrandi
if you could get one of them to join this IRC or maybe ping me on discord or something i can try
-
mgrandi
basically this is what i've come up with, i think the JSON api response + images is the most important at the moment
-
Jean-Fred
They hang out on the VGPC discord
-
mgrandi
if you have a link i'll join
-
Jean-Fred
-
mgrandi
but yeha, the API responses i think are what i should be targeting, the HTML is just...a rendered versions of this and take forever to do one region, and they are...aggressive at banning from hitting it too hard
-
Jean-Fred
I understand your position ; just to preach for my chapel: 1/ Fairly sure the JSON blobs and images hae been archived by VGPC people / mirrored in SerialStation and 2/ For Wikipedia purposes, it’s difficult to use an archived JSON blob as source for a statement (eg the USK or PEGI rating) while the store HTML page is good for it
-
Jean-Fred
(And yes, surprisingly, for some data, the only readily found and official looking source seems to be the Store HTML pages − community websites/DBs like MobyGames or SerialStation, however respectable and serious they are, do not cut it as "not official enough" :-( )
-
Jean-Fred
Let’s continue on the VGPC discord :)
-
kiska
In about an hour I am going to upgrade gitea on git.kiska.pw :D
-
arkiver
wooh
-
kiska
Starting upgrade now
-
JAA
:-)
-
kiska
Completed update to 1.11.8 :P
-
arkiver
what is the new awesomeness
-
kiska
Probably not much :D
-
arkiver
:P
-
kiska
-
JAA
It was 1.11.6 before, just a few bug fixes.
-
JAA
1.12.0 is where the cool new features are.
-
kiska
Looks like I don't need to worry about 1.12.0 breaking things?
-
JAA
There are some breaking changes, so not sure.
-
JAA
Also, this reminds me that I wanted to submit a PR for 1.13.0.
-
kiska
:D
-
kiska
Actually I am going to update to 1.12.5 and see what breaks :D
-
JAA
It seems that the breaking changes on 1.12.0 are not problematic.
-
kiska
Well nothing has exploded yet
-
kiska
JAA: Can you confirm you have received a test email from postmaster⊙kp?
-
JAA
kiska: Yep
-
kiska
:D
-
kiska
Well that didn't break
-
kiska
JAA: So what are the cool features? Before I go and look at the releases
-
JAA
A key one for me personally are system-wide webhooks. That'll allow for proper IRC notifications. I've been wanting to implement that for a while.
-
kiska
Now you can :D
-
JAA
Yeah, if only the webhook payload were documented at all...
-
kiska
Ooops?
-
JAA
-
JAA
That's all that exists.
-
kiska
Perhaps open an issue?
-
JAA
The example is 3.5 years old and doesn't even reflect the current hooks at all.
-
JAA
-
kiska
I see...
-
JAA
Cool, docs.gitea.io is always the master branch, not the latest release. WTF?
-
JAA
-
JAA
Baffles me that they didn't think of that for so long...
-
JAA
But well, the documentation is in a pretty sorry state anyway.
-
nico_32
pct rescued: 47.21%, read errors: 247, remaining time: 1d 15h 18m
-
nico_32
old cdr rescue
-
Kaz
time to ask the important question
-
Kaz
does gitea run in docker
-
Kaz
cc kiska ^^
-
kiska
No :D
-
Kaz
maybe not _our_ gitea
-
Kaz
but does it.. in general
-
JAA
-
Kaz
kiska: remediate as above
-
Kaz
there's nothing I'd love to see more than gitea running alongside watchtower
-
kiska
You know my stance with being at least a couple versions behind :D
-
JAA
Changing things would probably break the backups, and Igloo hasn't been around in a while.
-
kiska
I only updated to 1.12.5 because JAA wanted the cool feature
-
kiska
I believe Igloo is running it from /usr/local/bin/gitea --backup I think is the switch
-
kiska
But I have no clue
-
kiska
Sorry --dump is the switch
-
JAA
kiska: ~gitea/backup.sh (warning, pretty gross)
-
kiska
:D
-
kiska
Not gonna lookl
-
JAA
There's also at least three Gitea executables on this system. :-|
-
JAA
Oh well. In any case, yeah, if we change that, definitely make sure the backups aren't affected.
-
kiska
:D
-
kiska
Now down to 2
-
kiska
Where are the rest?
-
JAA
Found one in ~root and one in ~gitea, plus the one in /usr/local/bin.
-
kiska
Done :D
-
kiska
Now there is only 1
-
JAA
:-)
-
Kaz
sod the backups
-
Kaz
if it's in docker, we just sto the ct, pull the whole volume, start container
-
Kaz
and thats the _worst case_ scenario
-
godane1
-
kiska
Anyway now with 1.12.5 installed on git.kiska.pw, I will not be updating to 1.13 until 1.15 has been released, unless JAA has a feature he would like