-
avoozlHi all, I'm looking for some tools/libraries to parse through large WARC archives.. My golang is pretty ok, so I can build some things on my own. I'm looking for something that connects a 'structured web scraper/extractor' but then on WARC archives, so I can convert a forum scrape into a bunch of database records (post, user, etc.)
-
avoozlDoes anything like that exist, or should I just continue building
-
JAAavoozl: Let's take this to #archiveteam-bs.
-
avoozloops, will do
-
SketchTheCowI am getting hammered, just hammered, on "Save the Bugtraq site"
-
JAA:-)
-
SketchTheCowHackers who were nutso about "the parler data, give it to me" are now turning to Bugtraq
-
SketchTheCowYou'd think hackers would know how to archive bugtraq, or show up to do it
-
SketchTheCowRoll up sleeves, etc.