-
fireonlivecould we add 404media.co for periodic?
-
xkeyfireonlive++
-
eggdrop[karma] 'fireonlive' now has 39 karma!
-
xkey(someone might have a subscription of that outlet, they have a paywall against web-scraping… hmu in case)
-
arkiverJAA: what is is fixed?
-
arkiveraround the mp4s
-
arkiverthey have a patternlimit set to 0, and are being moved to a stash
-
arkiverah, redo didn't have mp4s moved out yet
-
arkiverthat is fixed?
-
arkiverJAA: on loading more backlog into secondary, it still has 100+ million items
-
datechnomanWe also have a stack of mp4's to slowly smash through and PDF files I want to queue. We aren't running out anytime soon :D
-
datechnomanPlus the med pub journals and stuff
-
nyanytodo, todo, todo is on fire~
-
datechnomanarkiver - Just submitted a pull request to push in some new medical research sources. Feel free to edit and publish. Hope it helps and if your happy ill keep digging when I get some spare time :)
-
JAAarkiver: Yeah, 12 MP4s were stuck in redo, so I moved them to the stash.
-
JAAI thought secondary was empty, but maybe not then. :-)
-
nyanyJAA: i wish secondary was empty
-
nyanythat's where we're getting most of our shit right now
-
nyanybut alas, it's a WIP
-
JAAKeep plucking away, and eventually it will be. :-)
-
thubanhi, can i get transfer.archivete.am/14uA9p/discord_groups_sorted.txt archived? 3e2 scanlation group links from a discord hub (deduplicated but not filtered)
-
eggdropinline (for browser viewing): transfer.archivete.am/inline/14uA9p/discord_groups_sorted.txt
-
fireonlivethuban: you don't care if there's no recursion/confirmation of success ye?
-
thubanyep yep
-
fireonlivekk
-
fireonlive
-
h2ibotfireonlive: Registering tD8dBupN for '!a transfer.archivete.am/14uA9p/discord_groups_sorted.txt'
-
h2ibotfireonlive: Deduplicating and queuing 269 items. (tD8dBupN)
-
h2ibotfireonlive: Deduplicated and queued 269 items. (tD8dBupN)
-
thubanty!
-
fireonlive:)
-
hehuwu
-
fireonlivecool
-
fireonlive?
-
katiavirus
-
VokunIs this a thought worth entertaining? I'm thinking sometime in the distant future to have a public page kind of like SPN for urls that anyone could put a single link into to save, or maybe an extension that could submit a link to a project like this. It would be low volume per person. I like spn but it's insanely slow and breaks a lot, and it'd be neat to have a tool like urls for the layman to have access to
-
VokunTo hook into this project, or one similar I mean.
-
VokunThis also sounds like something that someone might have definitely asked before, so, sorry if I didn't see the last answer
-
fireonlivei believe that's the goal of #Y / wiki.archiveteam.org/index.php/Distributed_recursive_crawls (minus the webpage - based on IRC) but could be wrong
-
OrIdow6Also depends on whether by "SPN" you mean with or without JS
-
OrIdow6I don't see how #Y fits that description
-
JAAAnd whether you care about feedback for how things went.