-
h2ibotJustAnotherArchivist edited Elections/2022 May Swiss votes (+5683): wiki.archiveteam.org/?diff=48591&oldid=48495
-
h2ibotJustAnotherArchivist edited Elections/2022 May Swiss votes (+37): wiki.archiveteam.org/?diff=48592&oldid=48591
-
h2ibotJustAnotherArchivist edited Internet infrastructure (+941, /* IETF (Internet Engineering Task Force) */…): wiki.archiveteam.org/?diff=48593&oldid=48588
-
ArcorannWhat's the policy on archiving election-related stuff?
-
JAAYes
-
JAA:-)
-
JAAAlso, #vooterbooter
-
JAALooks like that was never added to the wiki for some reason. Fixed now.
-
h2ibotJustAnotherArchivist edited Elections (+42, Add IRC channel): wiki.archiveteam.org/?diff=48594&oldid=48496
-
tech234alennier1: some tips for iOS app metadata scraping: I think you can get a smaller webpage containing similar data (check to make sure it has what you need though) if you use iTunes' user agent string (something like: iTunes/12.6.5 (Windows; Microsoft Windows 10.0 x64 Home Premium Edition (Build 17763); x64) AppleWebKit/7605.1033.1002.2) and also there is a sitemap with the apps at apps.apple.com/sitemaps_apps_index_1.xml
-
TheTechRobolennier1: Also try WARC. To use Warcprox with Python requests at least, (not sure what that scraping library is using) set the environment variables:
-
TheTechRoboHTTP_PROXY="localhost:8000" HTTPS_PROXY="localhost:8000" (yes, http) CURL_CA_BUNDLE=""
-
TheTechRoboThe latter removes certificate verification, so be careful. There's probably a better way to override the cert store but I couldn't find a way that actually worked.
-
h2ibotThemadprogramer edited Discourse (+63, /* Active Discourses */ Added MongoDB Community): wiki.archiveteam.org/?diff=48595&oldid=48590