22:15:35 <Pedrosso> Does running at high concurrency lead to many of the same domain being archived at once, or does each concurrent archive have a guaranteed different domain?
22:17:16 <imer> Pedrosso: tasks are only handed out to one worker at a time (except for retries of course, but those have a wait inbetween)
22:17:25 <imer> also applies for the concurrency setting
22:17:46 <imer> each task being one url to archive
22:17:58 <Pedrosso> so high concurrency means archiving one url faster?
22:18:04 <imer> multiple urls at once
22:18:07 <Pedrosso> good
22:18:31 <JAA> URLTeam is the one where the tracker rate-limits you per target site.
23:43:55 <vokunal|m> Not sure if we want them, but here's everything from the past few archives in Disgard https://transfer.archivete.am/9y8tN/urls-discard-nov-14-23.txt
23:44:02 <vokunal|m> ~247K urls
23:44:35 <vokunal|m> Discard*