00:00:10 !a https://transfer.archivete.am/iAxba/urls_batch_0001_002.txt 00:00:18 datechnoman: Registering Jpt5bQzJ for '!a https://transfer.archivete.am/iAxba/urls_batch_0001_002.txt' 00:32:58 datechnoman: Skipped 4111 invalid URLs: https://transfer.archivete.am/Wkc2t/urls_batch_0001_002.txt.bad-urls.txt (Jpt5bQzJ) 00:33:00 datechnoman: Skipped 45 very long URLs: https://transfer.archivete.am/Ppny4/urls_batch_0001_002.txt.skipped.txt (Jpt5bQzJ) 00:33:01 datechnoman: Deduplicating and queuing 13153792 items. (Jpt5bQzJ) 00:48:54 datechnoman: Deduplicated and queued 13153795 items. (Jpt5bQzJ) 00:50:03 imer (Cc arkiver): ^https?://[^/]*%.ucsf%.edu/blog%?.*&date%%5B.*&date%%5B.*&date%%5B added 00:50:10 JAA++ 00:50:11 -eggdrop- [karma] 'JAA' now has 86 karma! 00:50:33 I can't quite tell where these ugly URLs come from, but that should cover the brunt of it without false positives. 00:51:09 can confirm look to be dropping off 03:03:24 !a https://transfer.archivete.am/SWoC6/urls_batch_0002_000.txt 03:03:25 datechnoman: Registering muz0y1c1 for '!a https://transfer.archivete.am/SWoC6/urls_batch_0002_000.txt' 03:42:30 datechnoman: Skipped 7928 invalid URLs: https://transfer.archivete.am/78Fe7/urls_batch_0002_000.txt.bad-urls.txt (muz0y1c1) 03:42:32 datechnoman: Skipped 51 very long URLs: https://transfer.archivete.am/xPsNi/urls_batch_0002_000.txt.skipped.txt (muz0y1c1) 03:42:33 datechnoman: Deduplicating and queuing 24992021 items. (muz0y1c1) 04:10:22 !a https://transfer.archivete.am/DkayG/urls_batch_0002_001.txt 04:10:23 datechnoman: Registering EbkVe1md for '!a https://transfer.archivete.am/DkayG/urls_batch_0002_001.txt' 04:13:10 datechnoman: Deduplicated and queued 24992023 items. (muz0y1c1) 05:08:04 datechnoman: Skipped 6958 invalid URLs: https://transfer.archivete.am/C3GWy/urls_batch_0002_001.txt.bad-urls.txt (EbkVe1md) 05:08:06 datechnoman: Skipped 82 very long URLs: https://transfer.archivete.am/qIoF3/urls_batch_0002_001.txt.skipped.txt (EbkVe1md) 05:08:07 datechnoman: Deduplicating and queuing 24992959 items. (EbkVe1md) 05:25:38 !a https://transfer.archivete.am/8zcr8/urls_batch_0002_002.txt 05:25:38 datechnoman: Registering C95BZdY2 for '!a https://transfer.archivete.am/8zcr8/urls_batch_0002_002.txt' 05:54:29 datechnoman: Skipped 4161 invalid URLs: https://transfer.archivete.am/el6up/urls_batch_0002_002.txt.bad-urls.txt (C95BZdY2) 05:54:31 datechnoman: Skipped 55 very long URLs: https://transfer.archivete.am/6rJnJ/urls_batch_0002_002.txt.skipped.txt (C95BZdY2) 05:54:32 datechnoman: Deduplicating and queuing 13163367 items. (C95BZdY2) 05:56:54 datechnoman: Deduplicated and queued 24992967 items. (EbkVe1md) 06:02:48 !status 06:02:48 datechnoman: Jobs running: 1, jobs waiting for a slot: 0. 06:03:11 !a https://transfer.archivete.am/HHjgx/urls_batch_0003_000.txt 06:03:11 datechnoman: Registering yfDJX8mt for '!a https://transfer.archivete.am/HHjgx/urls_batch_0003_000.txt' 06:12:41 datechnoman: Deduplicated and queued 13163367 items. (C95BZdY2) 06:45:11 datechnoman: Skipped 9456 invalid URLs: https://transfer.archivete.am/14vIvY/urls_batch_0003_000.txt.bad-urls.txt (yfDJX8mt) 06:45:13 datechnoman: Skipped 67 very long URLs: https://transfer.archivete.am/s7tSV/urls_batch_0003_000.txt.skipped.txt (yfDJX8mt) 06:45:14 datechnoman: Deduplicating and queuing 24990476 items. (yfDJX8mt) 06:45:37 !a https://transfer.archivete.am/l0Rzk/urls_batch_0003_001.txt 06:45:38 datechnoman: Registering 8Kw6UNLS for '!a https://transfer.archivete.am/l0Rzk/urls_batch_0003_001.txt' 07:36:24 datechnoman: Deduplicated and queued 24990478 items. (yfDJX8mt) 07:39:05 datechnoman: Skipped 7112 invalid URLs: https://transfer.archivete.am/Igtep/urls_batch_0003_001.txt.bad-urls.txt (8Kw6UNLS) 07:39:13 datechnoman: Skipped 106 very long URLs: https://transfer.archivete.am/12CUIF/urls_batch_0003_001.txt.skipped.txt (8Kw6UNLS) 07:39:14 datechnoman: Deduplicating and queuing 24992782 items. (8Kw6UNLS) 07:51:25 !a https://transfer.archivete.am/3RT3n/urls_batch_0003_002.txt 07:51:25 datechnoman: Registering DPEnRxTu for '!a https://transfer.archivete.am/3RT3n/urls_batch_0003_002.txt' 08:10:39 datechnoman: Deduplicated and queued 24992787 items. (8Kw6UNLS) 08:26:44 datechnoman: Skipped 3169 invalid URLs: https://transfer.archivete.am/r9OXW/urls_batch_0003_002.txt.bad-urls.txt (DPEnRxTu) 08:26:46 datechnoman: Skipped 50 very long URLs: https://transfer.archivete.am/3FG70/urls_batch_0003_002.txt.skipped.txt (DPEnRxTu) 08:26:47 datechnoman: Deduplicating and queuing 13578928 items. (DPEnRxTu) 08:43:10 datechnoman: Deduplicated and queued 13578930 items. (DPEnRxTu) 10:22:47 !a https://transfer.archivete.am/b102I/urls_batch_0004_000.txt 10:22:48 datechnoman: Registering AZzhhrFD for '!a https://transfer.archivete.am/b102I/urls_batch_0004_000.txt' 11:06:08 datechnoman: Skipped 7042 invalid URLs: https://transfer.archivete.am/gZj0l/urls_batch_0004_000.txt.bad-urls.txt (AZzhhrFD) 11:06:10 datechnoman: Skipped 81 very long URLs: https://transfer.archivete.am/FwKje/urls_batch_0004_000.txt.skipped.txt (AZzhhrFD) 11:06:11 datechnoman: Deduplicating and queuing 24992876 items. (AZzhhrFD) 11:36:04 datechnoman: Deduplicated and queued 24992880 items. (AZzhhrFD) 11:42:03 !a https://transfer.archivete.am/eEk0L/urls_batch_0004_001.txt 11:42:04 datechnoman: Registering gZQBxAIv for '!a https://transfer.archivete.am/eEk0L/urls_batch_0004_001.txt' 12:27:50 datechnoman: Skipped 7317 invalid URLs: https://transfer.archivete.am/EB2Af/urls_batch_0004_001.txt.bad-urls.txt (gZQBxAIv) 12:27:52 datechnoman: Skipped 92 very long URLs: https://transfer.archivete.am/LcZ5i/urls_batch_0004_001.txt.skipped.txt (gZQBxAIv) 12:27:53 datechnoman: Deduplicating and queuing 24992591 items. (gZQBxAIv) 12:45:20 !a https://transfer.archivete.am/7jxYe/urls_batch_0004_002.txt 12:45:21 datechnoman: Registering CeTURJEy for '!a https://transfer.archivete.am/7jxYe/urls_batch_0004_002.txt' 13:03:43 datechnoman: Deduplicated and queued 24992594 items. (gZQBxAIv) 13:14:08 datechnoman: Skipped 5097 invalid URLs: https://transfer.archivete.am/3XnBo/urls_batch_0004_002.txt.bad-urls.txt (CeTURJEy) 13:14:10 datechnoman: Fixed 1 unprintable URLs: https://transfer.archivete.am/QgHeR/urls_batch_0004_002.txt.not-printable.txt (CeTURJEy) 13:14:11 datechnoman: Skipped 36 very long URLs: https://transfer.archivete.am/14SS84/urls_batch_0004_002.txt.skipped.txt (CeTURJEy) 13:14:13 datechnoman: Deduplicating and queuing 13325591 items. (CeTURJEy) 13:32:35 datechnoman: Deduplicated and queued 13325593 items. (CeTURJEy) 20:45:16 !a https://transfer.archivete.am/10c2QT/urls_batch_0005_000.txt 20:45:17 datechnoman: Registering y1Qa6ZcS for '!a https://transfer.archivete.am/10c2QT/urls_batch_0005_000.txt' 20:53:03 thanks JAA for the patterns 20:53:17 i've been very busy the last few days, haven't been able to pay good attention 21:29:58 datechnoman: Skipped 7003 invalid URLs: https://transfer.archivete.am/gXKcN/urls_batch_0005_000.txt.bad-urls.txt (y1Qa6ZcS) 21:30:00 datechnoman: Skipped 70 very long URLs: https://transfer.archivete.am/asWZT/urls_batch_0005_000.txt.skipped.txt (y1Qa6ZcS) 21:30:02 datechnoman: Deduplicating and queuing 24992927 items. (y1Qa6ZcS) 21:59:52 datechnoman: Deduplicated and queued 24992930 items. (y1Qa6ZcS) 22:40:05 !a https://transfer.archivete.am/W3id3/urls_batch_0005_001.txt 22:40:06 datechnoman: Registering YmkN2BH7 for '!a https://transfer.archivete.am/W3id3/urls_batch_0005_001.txt' 23:24:49 datechnoman: Skipped 7441 invalid URLs: https://transfer.archivete.am/ki0rQ/urls_batch_0005_001.txt.bad-urls.txt (YmkN2BH7) 23:24:51 datechnoman: Skipped 92 very long URLs: https://transfer.archivete.am/DqlAk/urls_batch_0005_001.txt.skipped.txt (YmkN2BH7) 23:24:52 datechnoman: Deduplicating and queuing 24992466 items. (YmkN2BH7) 23:54:51 datechnoman: Deduplicated and queued 24992473 items. (YmkN2BH7)