01:36:09 <datechnoman> The sitemaps are here. Brace yourselves :O
01:39:19 <Flashfire42> https://youtu.be/xAYSqTu5_ZY
01:59:49 <imer> huh, targets started clogging around an hour before that from the looks
04:45:37 <pabs> that_lurker: lebanon too maybe? or possibly just all the surrounding countries
10:06:00 <datechnoman> !a https://transfer.archivete.am/t6Neu/urls_batch_0003_000.txt
10:06:01 <h2ibot> datechnoman: Registering oOwUQerD for '!a https://transfer.archivete.am/t6Neu/urls_batch_0003_000.txt'
10:48:04 <h2ibot> datechnoman: Skipped 3447 invalid URLs: https://transfer.archivete.am/3keqI/urls_batch_0003_000.txt.bad-urls.txt (oOwUQerD)
10:48:06 <h2ibot> datechnoman: Skipped 59 very long URLs: https://transfer.archivete.am/OZes4/urls_batch_0003_000.txt.skipped.txt (oOwUQerD)
10:48:07 <h2ibot> datechnoman: Deduplicating and queuing 24996493 items. (oOwUQerD)
11:21:26 <h2ibot> datechnoman: Deduplicated and queued 24996499 items. (oOwUQerD)
12:54:33 <datechnoman> !a https://transfer.archivete.am/3J6Od/pdf_urls_batch_1.txt
12:54:34 <h2ibot> datechnoman: Registering uUSYR0dB for '!a https://transfer.archivete.am/3J6Od/pdf_urls_batch_1.txt'
13:32:59 <h2ibot> datechnoman: Skipped 86480 invalid URLs: https://transfer.archivete.am/11aPQH/pdf_urls_batch_1.txt.bad-urls.txt (uUSYR0dB)
13:33:00 <h2ibot> datechnoman: Fixed 13 unprintable URLs: https://transfer.archivete.am/Z8R2B/pdf_urls_batch_1.txt.not-printable.txt (uUSYR0dB)
13:33:01 <h2ibot> datechnoman: Skipped 64 very long URLs: https://transfer.archivete.am/lc2TV/pdf_urls_batch_1.txt.skipped.txt (uUSYR0dB)
13:33:02 <h2ibot> datechnoman: Deduplicating and queuing 24913456 items. (uUSYR0dB)
14:03:12 <h2ibot> datechnoman: Deduplicated and queued 24913477 items. (uUSYR0dB)
14:05:14 <nstrom|m> rsync to optane10 seems lightly unhappy atm, seeing some connection reset by peer / broken pipe across a few workers.
14:05:44 <nstrom|m> that said looks like some beefy items (1GB+) being sent
20:37:37 <imer> rewby: any chance you can check whats up?
20:39:07 <Notrealname1234> about what?
20:39:17 <imer> target troubles
20:39:54 <Notrealname1234> Okay
23:20:25 <datechnoman> !a https://transfer.archivete.am/gbniw/urls_batch_0003_001.txt
23:20:25 <h2ibot> datechnoman: Registering dNky4aw1 for '!a https://transfer.archivete.am/gbniw/urls_batch_0003_001.txt'