00:30:16 datechnoman: Deduplicated and queued 24995592 items. (JzdPFvzz) 00:42:32 datechnoman: Skipped 4465 invalid URLs: https://transfer.archivete.am/U3Kfb/edu_urls_batch_0004_001.txt.bad-urls.txt (0HVInap1) 00:42:33 datechnoman: Fixed 4 unprintable URLs: https://transfer.archivete.am/lcz1l/edu_urls_batch_0004_001.txt.not-printable.txt (0HVInap1) 00:42:35 datechnoman: Skipped 105 very long URLs: https://transfer.archivete.am/16f7X5/edu_urls_batch_0004_001.txt.skipped.txt (0HVInap1) 00:42:36 datechnoman: Deduplicating and queuing 24995430 items. (0HVInap1) 01:11:07 datechnoman: Deduplicated and queued 24996270 items. (0HVInap1) 02:31:23 !a https://transfer.archivete.am/6gGBU/edu_urls_batch_0004_002.txt 02:31:24 datechnoman: Registering E19mbZz6 for '!a https://transfer.archivete.am/6gGBU/edu_urls_batch_0004_002.txt' 03:02:45 datechnoman: Skipped 3724 invalid URLs: https://transfer.archivete.am/2S1dh/edu_urls_batch_0004_002.txt.bad-urls.txt (E19mbZz6) 03:02:46 datechnoman: Fixed 1 unprintable URLs: https://transfer.archivete.am/MFNUd/edu_urls_batch_0004_002.txt.not-printable.txt (E19mbZz6) 03:02:48 datechnoman: Skipped 116 very long URLs: https://transfer.archivete.am/thYV5/edu_urls_batch_0004_002.txt.skipped.txt (E19mbZz6) 03:02:49 datechnoman: Deduplicating and queuing 19712991 items. (E19mbZz6) 03:14:23 !a https://transfer.archivete.am/spQ7a/edu_urls_batch_0005_000.txt 03:14:26 datechnoman: Registering gQ1FI2Yn for '!a https://transfer.archivete.am/spQ7a/edu_urls_batch_0005_000.txt' 03:31:43 datechnoman: Deduplicated and queued 19713731 items. (E19mbZz6) 03:34:34 datechnoman: Skipped 1250 invalid URLs: https://transfer.archivete.am/oacw3/edu_urls_batch_0005_000.txt.bad-urls.txt (gQ1FI2Yn) 03:34:36 datechnoman: Fixed 1 unprintable URLs: https://transfer.archivete.am/10kWFw/edu_urls_batch_0005_000.txt.not-printable.txt (gQ1FI2Yn) 03:34:39 datechnoman: Skipped 23 very long URLs: https://transfer.archivete.am/ySQCv/edu_urls_batch_0005_000.txt.skipped.txt (gQ1FI2Yn) 03:34:41 datechnoman: Deduplicating and queuing 8951894 items. (gQ1FI2Yn) 03:44:13 datechnoman: Deduplicated and queued 8952172 items. (gQ1FI2Yn) 03:52:49 !a https://transfer.archivete.am/10CDSK/edu_urls_batch_0000_000.txt 03:52:49 datechnoman: Registering asvgpS5o for '!a https://transfer.archivete.am/10CDSK/edu_urls_batch_0000_000.txt' 04:33:22 datechnoman: Skipped 4578 invalid URLs: https://transfer.archivete.am/2ppoj/edu_urls_batch_0000_000.txt.bad-urls.txt (asvgpS5o) 04:33:23 datechnoman: Skipped 48 very long URLs: https://transfer.archivete.am/eSJG6/edu_urls_batch_0000_000.txt.skipped.txt (asvgpS5o) 04:33:24 datechnoman: Deduplicating and queuing 24995373 items. (asvgpS5o) 05:02:10 datechnoman: Deduplicated and queued 24995374 items. (asvgpS5o) 05:16:21 !a https://transfer.archivete.am/sxcvd/edu_urls_batch_0000_001.txt 05:16:21 datechnoman: Registering l9zq84vQ for '!a https://transfer.archivete.am/sxcvd/edu_urls_batch_0000_001.txt' 05:56:35 datechnoman: Skipped 9392 invalid URLs: https://transfer.archivete.am/ob09X/edu_urls_batch_0000_001.txt.bad-urls.txt (l9zq84vQ) 05:56:37 datechnoman: Skipped 128 very long URLs: https://transfer.archivete.am/k5h7P/edu_urls_batch_0000_001.txt.skipped.txt (l9zq84vQ) 05:56:38 datechnoman: Deduplicating and queuing 24990480 items. (l9zq84vQ) 06:26:16 datechnoman: Deduplicated and queued 24990482 items. (l9zq84vQ) 07:39:55 !a https://transfer.archivete.am/152pFg/edu_urls_batch_0000_002.txt 07:39:55 datechnoman: Registering gFwHpvMJ for '!a https://transfer.archivete.am/152pFg/edu_urls_batch_0000_002.txt' 08:04:34 datechnoman: Skipped 4254 invalid URLs: https://transfer.archivete.am/BBUDE/edu_urls_batch_0000_002.txt.bad-urls.txt (gFwHpvMJ) 08:04:36 datechnoman: Skipped 27 very long URLs: https://transfer.archivete.am/P2SLX/edu_urls_batch_0000_002.txt.skipped.txt (gFwHpvMJ) 08:04:37 datechnoman: Deduplicating and queuing 14294330 items. (gFwHpvMJ) 08:21:36 datechnoman: Deduplicated and queued 14294331 items. (gFwHpvMJ) 08:37:06 !a https://transfer.archivete.am/woLGo/edu_urls_batch_0001_000.txt 08:37:11 datechnoman: Registering eZbFm49C for '!a https://transfer.archivete.am/woLGo/edu_urls_batch_0001_000.txt' 09:26:06 datechnoman: Skipped 5293 invalid URLs: https://transfer.archivete.am/J9obs/edu_urls_batch_0001_000.txt.bad-urls.txt (eZbFm49C) 09:26:07 datechnoman: Skipped 31 very long URLs: https://transfer.archivete.am/nQSpC/edu_urls_batch_0001_000.txt.skipped.txt (eZbFm49C) 09:26:08 datechnoman: Deduplicating and queuing 24994675 items. (eZbFm49C) 09:42:49 !a https://transfer.archivete.am/p6htL/edu_urls_batch_0001_001.txt 09:42:49 datechnoman: Registering Fh4iZ7OY for '!a https://transfer.archivete.am/p6htL/edu_urls_batch_0001_001.txt' 09:56:45 !status 09:56:46 datechnoman: Jobs running: 2, jobs waiting for a slot: 0. 10:04:19 datechnoman: Deduplicated and queued 24994679 items. (eZbFm49C) 10:27:51 datechnoman: Skipped 5224 invalid URLs: https://transfer.archivete.am/ViE9f/edu_urls_batch_0001_001.txt.bad-urls.txt (Fh4iZ7OY) 10:27:53 datechnoman: Skipped 85 very long URLs: https://transfer.archivete.am/MJPjb/edu_urls_batch_0001_001.txt.skipped.txt (Fh4iZ7OY) 10:27:54 datechnoman: Deduplicating and queuing 24994691 items. (Fh4iZ7OY) 10:57:22 datechnoman: Deduplicated and queued 24994696 items. (Fh4iZ7OY) 12:15:11 !a https://transfer.archivete.am/NkKts/edu_urls_batch_0001_002.txt 12:15:12 datechnoman: Registering UKw0TewY for '!a https://transfer.archivete.am/NkKts/edu_urls_batch_0001_002.txt' 12:38:51 datechnoman: Skipped 4650 invalid URLs: https://transfer.archivete.am/psyFK/edu_urls_batch_0001_002.txt.bad-urls.txt (UKw0TewY) 12:38:53 datechnoman: Skipped 24 very long URLs: https://transfer.archivete.am/SookE/edu_urls_batch_0001_002.txt.skipped.txt (UKw0TewY) 12:38:54 datechnoman: Deduplicating and queuing 14043079 items. (UKw0TewY) 12:55:36 datechnoman: Deduplicated and queued 14043079 items. (UKw0TewY) 16:49:20 Hello! On september 17 replit will destroy almost all sites and a large amount of code on free accounts. I haven't found a way to save even 1% of the total due to captchas. All I managed to collect is 500 links - https://transfer.archivete.am/12R5Ms/repl.txt 16:49:20 inline (for browser viewing): https://transfer.archivete.am/inline/12R5Ms/repl.txt 18:05:30 Results: https://transfer.archivete.am/126uN3/repl-results.txt 18:05:31 inline (for browser viewing): https://transfer.archivete.am/inline/126uN3/repl-results.txt 18:07:36 nyuuzyou: I'll put the links in #archivebot as soon as I have time to do so :-) 19:06:49 Here's some pdf urls and .EDU I found from wikiteam if you're interested 19:06:49 https://transfer.archivete.am/9NCj8/pdf_urls.txt 19:06:49 https://transfer.archivete.am/iXGwv/edu_urls.txt 19:06:50 inline (for browser viewing): https://transfer.archivete.am/inline/9NCj8/pdf_urls.txt 19:07:26 I'm not sure if these lists are as clean as you're looking for, but it's what I managed to get 19:11:32 Vokun++ 19:11:32 -eggdrop- [karma] 'Vokun' now has 3 karma! 23:07:01 !a https://transfer.archivete.am/bCikD/edu_urls_batch_0002_000.txt 23:07:02 datechnoman: Registering Wx5KNGEC for '!a https://transfer.archivete.am/bCikD/edu_urls_batch_0002_000.txt' 23:50:50 datechnoman: Skipped 7874 invalid URLs: https://transfer.archivete.am/q9ouA/edu_urls_batch_0002_000.txt.bad-urls.txt (Wx5KNGEC) 23:50:52 datechnoman: Skipped 72 very long URLs: https://transfer.archivete.am/12QvWW/edu_urls_batch_0002_000.txt.skipped.txt (Wx5KNGEC) 23:50:53 datechnoman: Deduplicating and queuing 24992053 items. (Wx5KNGEC) 23:54:03 !a https://transfer.archivete.am/REDKk/edu_urls_batch_0002_001.txt 23:54:03 datechnoman: Registering gqnV5nbc for '!a https://transfer.archivete.am/REDKk/edu_urls_batch_0002_001.txt'