-
anarcatlocation.services.mozilla.com to be sunset, announced on march 13th
-
nicolas17rip
-
JAAFuck software patents.
-
fireonlive++
-
HP_Archivistpokechu22: I know you looked at libraw.org and adjusted, it finished earlier. (I had stepped away for a few hours..) Did you abort early or just adjust the crawl?
-
pokechu22HP_Archivist: I got rid of something that *should* have been junk (pagination URLs where there was a second, different, ignored, pagination param), but I'm not 100% sure if it was complete or not. Those URLs did make up most of the queue. I'll double-check.
-
HP_Archivistpokechu22: Ah alright, yeah I appreciate it. I recently learned that library is the basis to a variety of other software that processes camera RAW files. And the Libraw project is one that is based on *another* project that ceased in 2018, which I also want to make sure gets crawled properly
-
HP_Archivist
-
pokechu22HP_Archivist: I can confirm that it successfully requested all 125 pages from libraw.org/comments/recent?page=1 to libraw.org/comments/recent?page=125. The ignore I added was for stuff like libraw.org/comments/recent?destinat…=comments/recent%3Fpage%3D10&page=1 to
-
pokechu22libraw.org/comments/recent?destinat…omments/recent%3Fpage%3D10&page=125 which are the exact same as the actual page list, but with a second page number in the middle that does nothing (so instead of 125 requests for 125 pages, it'd be 15625 requests... which is just silly). The site's complete.
-
HP_ArchivistHm, alright. Thank you for checking!
-
h2ibotPetchea created Piapro (+1301, Created page with "{{Infobox project | title =…): wiki.archiveteam.org/?title=Piapro
-
h2ibotPetchea edited Piapro (+899): wiki.archiveteam.org/?diff=51888&oldid=51887
-
h2ibotPetchea edited Piapro (+52): wiki.archiveteam.org/?diff=51889&oldid=51888
-
h2ibotPetchea edited Piapro (-28): wiki.archiveteam.org/?diff=51890&oldid=51889
-
h2ibotPetchea edited Piapro (+283): wiki.archiveteam.org/?diff=51891&oldid=51890
-
h2ibotPetchea edited Piapro (+132, not just music): wiki.archiveteam.org/?diff=51892&oldid=51891
-
imer"On April 10th, 2024 the cell data downloads will be deleted and will no longer be available. " DELETED? (re mozilla location services)
-
PredatorIWDimer: Ran the downloads page location.services.mozilla.com/downloads through IA with Save outlinks on and it actually got First archive on most links but someone should still check it since that can miss crawling some links from the page.
-
imerit might not grab the larger downloads properly I think?
-
PredatorIWDIs there any surefire way to save a page like this on IA other than the basic web.archive.org/save UI?
-
imerarchivebot, I'm sure someone will run it through
-
PredatorIWDimer: I manually entered the 2 big downloads it missed as well, might have missed some smaller ones also
-
Bartoi've thrown location.services.mozilla.com into archivebot
-
imerthanks!
-
eightthreeare there projects for repeatedly backing up job posting sites (and maybe marketplaces/classifieds like gumtree) since those tend to be deleted fairly quickly, not sure if archive.org is anything close to thorough at keeping copies...
-
JAAIf you have a good list of such sites/pages, we could throw them into #//'s thing.
-
eightthreeJAA: they are often geographically limited, how much do I need to parse these and come up with a deduplicated, sorted list, also carving out subsections of host/domains that are job specific (i.e. the format of urls for jobs in hackernews, linkedin, etc?): en.wikipedia.org/wiki/List_of_employment_websites
-
eightthree
-
eightthree
-
eightthree
-
eightthree
-
eightthree
-
eightthreegithub.com/remoteintech/remote-jobs (seems like a list of employer websites, not likely frequent posted and deleted content like jobs)
-
eightthree
-
eightthree
-
JAAIdeally, you'd compile a list and create a PR against github.com/ArchiveTeam/urls-sources .
-
eightthreeok, this wont be done anytime in the next week from me, but if someone wants to start PRing I welcome it
-
eightthreeI was actually surprised this hasnt been done yet by archiveteam, I was hoping to find where to find the archives! (currently jobsearching and a little in hurry to find income)
-
nicolas17eightthree: why archive them? historical data analysis?
-
nicolas17for actual job search you'd only care about recent posts...
-
eightthreenicolas17: so there's urgent searching and then there's "how long to wait and how infrequently does "dream job" or "rare desirable item for sale" show up in jobsites/classifieds/marketplaces. I was noticing a lot of "this post disappeared" type messages, getting confused and annoyed and feeling like this was worth publicly archiving...
-
nicolas17(what's a "dream job", I don't understand)
-
nicolas17(half joking)