-
asdf81How does one archive dark web materials? Is there a way to make wget/httrack crawl an onionsite?
-
wizardstorsocks lets you run applications over tor. just tested and it works on onion sites with wget
-
JAAI think that's also what we used on the ArchiveBot Tor pipelines (which no longer exist).
-
wizardsnote that using wget will make you stand out considerably from normal tor users, so a site could choose to deny you access or serve you different content
-
OrIdow6That's not really a TOR-only concern
-
OrIdow6Unless it's very prevalent for onion sites
-
hexa-meh, I mostly read -bs as bullshit
-
hexa-what does it stand for?
-
hexa-oooh, bikeshed?
-
OrIdow6No, it was originally an offtopic channel
-
OrIdow6Your original guess was right
-
OrIdow6But at some point it became the discussion channel, and #archiveteam became onyl an announcements channel
-
» hexa- nods
-
» pabs wonders if it would be worth renaming the channels -announce/-discuss/-offtopic or -ohshit/-archivethis/-blather or something
-
Frogging101It would be less confusing with different names. But I don't see it happening
-
Frogging101-ot is a fine name
-
Frogging101-bs is the only name that's misleading -- or at least, ambiguous enough that people need to ask what it's for
-
Frogging101then again, the topic in #archiveteam and #archiveteam-bs answer that
-
Frogging101but there are some who believe that "people never read the topic"
-
tech234aPersonally I think #archiveteam should become #archiveteam-announce
-
tech234aLooks like that channel is already reserved
-
hexa-agreed, 100% of people read channel names, less than 50% read topics
-
jamesptech234a: But that is where anyone can make an announcement of if anything happens.
-
JAAThis sounds like something for a quorum, and also definitely not -ot. :-)