-
ishkurcan someone increment the integer at the end of this url and archive please? <3 bo.dica.gov.mm/pages/company-details/2
-
Syliranaishkur: Do you hhappen to know how far this goes? It returns the exact same result for an entry without information (for example 3) and one that probably doesn't exist (for example 999999999). It requests the data using JSON by the way, which would probably be more useful for you if you want to parse it later. But we'd have to know the upper limit as there doesn't seem to be a way to determine it from the server replies.
-
ishkurSylirana: i have API creds for the thing this queries
-
ishkur
-
SyliranaWell the JS seems to include a token for it anyway, which can easily be extracted. The issue is that it replies with the same message and there seems to be no way to know when we're done archiving since it might just be an entry without any data.
-
ishkurchecking now
-
ishkur393
-
SyliranaSo 2 to 393?
-
ishkuryep
-
ishkurthere is a rate limit
-
SyliranaSorry, had to go for a bit. Something like this should work: bin.privacytools.io/?1899dcc06bdacf…ZDmWuS94q2mUdgNvDRdzTWwVnZ9gXEgptPx .
-
SyliranaWith that accept header, the empty ones still return valid JSON instead of some 404 HTML page.
-
SyliranaMake sure to run this inside a folder for the files since it will create a file for each request.
-
ishkurthanks
-
ishkurcould we get a project going for *.gov.mm?
-
ishkur
-
jodizzleishkur: Already underway, to some extent. For more discussion, #archiveteam-bs
-
ishkurjodizzle: thank you