-
h2ibot
Tech234a edited Current Projects (+54, Update Twitter, Miraheze):
wiki.archiveteam.org/?diff=50504&oldid=50503
-
mikolaj|m
fireonlive: yeah forum-dl uses warcio. I don't know any alternative at the moment
-
mikolaj|m
fireonlive: what is the tool you're trying to extract outlinks with?
-
mikolaj|m
Btw. Is there a CLI tool to upload a list of URLs to the Wayback Machine via the Save Page Now interface?
-
mikolaj|m
Ideally one that runs in the background, has a proper delay once max. number of uploads is hit, and has a queue that persists between reboots
-
fireonlive
ahh, not sure myself. maybe JAA would know if ther's something better for python
-
fireonlive
-
fireonlive
with 'scrape'
-
fireonlive
coulda been doing it wrong though: $ ./warc-tiny scrape -u <(zcat /var/www/html/forums.tomshardware.com.warc.gz) | Info: processing /proc/self/fd/11 | Warning: malformed HTTP request or response in record b'<
urn:uuid:3f71c8a7-d982-451c-9d47-2ac12d541019>', skipping | (lots of the same, different uuids)
-
mikolaj|m
I'll take a look at this later
-
fireonlive
thanks mikolaj|m :)
-
fireonlive
mikolaj|m: with the turmoil around LTT not sure if that could be supported in it
-
pabs
mikolaj|m: is ArchiveBot good enough?
-
h2ibot
Yts98 edited Xuite (+171, Update project info):
wiki.archiveteam.org/?diff=50505&oldid=50452
-
h2ibot
-
h2ibot
Yts98 edited Xuite (+1172, Add dv and snap):
wiki.archiveteam.org/?diff=50507&oldid=50506
-
h2ibot
-
mikolaj|m
pabs: sure, but you need to join the channel and either ask someone or have permissions to use it, and I often have something like less 30 pages to archive that I can easily do through the Save Page Now interface
-
TheTechRobo
I know of one but I don’t have a link
-
TheTechRobo
look up site:github.com wayback-machine-spn-scripts
-
TheTechRobo
Or something along those lines
-
TheTechRobo
It doesn’t persist reboots though I don’t think though it might be resumable
-
TheTechRobo
Ive never tried
-
h2ibot
Exorcism edited Deathwatch (+225, /* 2024 */):
wiki.archiveteam.org/?diff=50509&oldid=50448
-
h2ibot
Exorcism edited Deathwatch (+21, /* 2024 */):
wiki.archiveteam.org/?diff=50510&oldid=50509
-
JAA
Thanks!
-
Exorcism
petrichor|m: quit and rejoin, normally this should fix it
-
Exorcism
fck xrong channel
-
nstrom|m
if anyone has fresh IPs they can throw at #bowlofpetunias it could probably use the help. 2 days til shutdown and the site bans anything higher than 1 concurrency really quickly :(
-
pabs
mikolaj|m: anyways, I think the best way to do that is send an email to the SPN API address, it will save stuff and mail you back
-
pabs
savepagenow⊙ao
-
TheTechRobo
pabs: I've never had much success with that
-
TheTechRobo
It seems really flaky
-
pabs
it worked fairly well when I did it
-
TheTechRobo
huh
-
pabs
the SPN web form has annoying rate limiting, but the email thing you can chuck tons of links in
-
h2ibot
-
h2ibot
Exorcism created WeVidi (+296, Created page with "{{Infobox project | image =…):
wiki.archiveteam.org/?title=WeVidi
-
mikolaj|m
Thanks, i didnt know about this email thing
-
h2ibot
-
h2ibot
-
h2ibot
Exorcism created SubRocks (+345, Created page with "{{Infobox project | logo =…):
wiki.archiveteam.org/?title=SubRocks
-
h2ibot
-
h2ibot
Exorcism created EraCast (+302, Created page with "{{Infobox project | image =…):
wiki.archiveteam.org/?title=EraCast
-
h2ibot
Exorcism created VidBit (+263, Created page with "{{Infobox project | title =…):
wiki.archiveteam.org/?title=VidBit
-
Barto
-
Barto
(seen on hn)
-
Barto
-
fireonlive
-
fireonlive
this person did some more digging of his past tweet) account required or i can link each tweet
-
qwertyasdfuiopghjkl
-
fireonlive
sweeet
-
fireonlive
,, foreach chan [list #archiveteam-ot #archiveteam-bs] { channel set $chan +nitter }
-
eggdrop
ok: (no output) -21ms-
-
Barto
qwertyasdfuiopghjkl: great
-
egallager
hi
-
pokechu22
hi
-
egallager
wondering about this claim of Twitter photo deletion:
twitter.com/MosquitoCapital/status/1692933610809008180
-
eggdrop
-
pokechu22
nitter.net/simonw/status/1692925812570234968 was previously linked but I don't think anything else was explained for it
-
egallager
btw I have a few edits on the wiki awaiting moderation
-
fireonlive
SketchCow: is it something like clearing out spam/people uploading seasons of $populartvshow? or just more capacity kinda thing?
-
arkiver
fireonlive: what?
-
fireonlive
re the announcement in archiveteam
-
arkiver
right
-
fireonlive
was curious how fillnew was being clawed back
-
arkiver
not related to clearing out spam/people uploading seasons of $populartvshow
-
arkiver
FILL nodes are the nodes that can currently be written to
-
fireonlive
sketch made an announcement about 8 hours ago
-
fireonlive
ahh
-
fireonlive
like a pool of available workers
-
arkiver
yeah it's related to what i wrote before
-
arkiver
temporary relieve, but will soon get bad again
-
fireonlive
mm :(