04:17:10 <datechnoman> arkiver Request to blackhole the follow URL's on the tracker due to 403 errors for all URL's trying to be archived on "http://epicvin.com/*****"
04:17:44 <datechnoman> eg; 8=403 http://epicvin.com/check-vin-number-and-get-the-vehicle-history-report/checkout/5n1az2ms2kn110860
04:18:41 <datechnoman> Also hitting thousands of URL's on the domain "http://www.rosarioalerta.com" which gives only Server returned 0 (CONERROR) errors
04:18:51 <datechnoman> eg; 1=0 http://www.rosarioalerta.com/img/?id=jQJxG
04:20:22 <datechnoman> Id say its blocking our IP's so we are just wasting our time on that
10:54:58 <arkiver> thanks datechnoman looking into that
10:56:31 <arkiver> rosario is filtered out
10:56:42 <datechnoman> no worries mate. Chewing through URL's atm but that should speed it up a lot more. Half the logs in seeing Server returned 0 (CONERROR) errors results
10:57:15 <arkiver> thanks for running this project :)
10:57:21 <arkiver> we got into a bit of a backlog
10:58:31 <arkiver> nice 60% filter rate now
10:59:09 <datechnoman> Sure thing. I had to drop off for a month as life has been busy with a new baby and had to change my priorities but hopefully should be back more often again :)
10:59:21 <datechnoman> Slurping URL's up lol
11:04:31 <datechnoman> Thanks for filtering those out. Im heading to bed but if I see anymore ill ping you. Much more traffic flowing now
11:05:38 <arkiver> new baby!!
11:05:43 <arkiver> congratulations!
11:05:49 <datechnoman> Thanks so much. First one :)
11:06:03 <arkiver> awesome! very nice
11:06:23 <arkiver> i hope you'll still be able to get enough sleep at night
11:06:34 <arkiver> (no baby here, but I heard things :P)
11:08:59 <arkiver> !a https://transfer.archivete.am/Ffk0C/twitter-big-scrapes-batch4-outlinks.zst
11:09:04 <arkiver> !a https://transfer.archivete.am/Ffk0C/twitter-big-scrapes-batch4-outlinks
11:09:09 <arkiver> (whoops)
11:11:48 <h2ibot> arkiver: Skipped 3430104 bad URLs: https://transfer.archivete.am/13o95O/twitter-big-scrapes-batch4-outlinks.zst.bad-urls.txt
11:12:02 <arkiver> yeah, it doesn't handle compressed data
11:12:27 <h2ibot> arkiver: Fixed 2737001 unprintable URLs: https://transfer.archivete.am/wHwwf/twitter-big-scrapes-batch4-outlinks.zst.not-printable.txt
11:12:28 <h2ibot> arkiver: Deduplicating and queuing 0 items.
11:12:29 <h2ibot> arkiver: Deduplicated and queued 0 items.
11:14:59 <h2ibot> arkiver: Skipped 431 bad URLs: https://transfer.archivete.am/15PZpn/twitter-big-scrapes-batch4-outlinks.bad-urls.txt
11:15:19 <h2ibot> arkiver: Deduplicating and queuing 7926111 items.
11:23:49 <h2ibot> arkiver: Deduplicated and queued 7926111 items.
11:40:49 <datechnoman> This little one has/is amazing and sleeps all the way through the night which is pretty much unheard of. Let's hope he keeps it up!
19:13:59 <Ryz> !ignore 4hlsa83cwub4ozjqxjxk8iy1g ^https?://www\.byzcath\.org/forums/ubbthreads\.php/ubb/showday/day/\d+/month/\d+/year/\d{3}$
19:14:00 <Ryz> Oops
23:44:36 <TheTechRobo> !a https://transfer.archivete.am/12WDva/discord-Fosshost
23:44:41 <h2ibot> TheTechRobo: Skipped 21 bad URLs: https://transfer.archivete.am/VSSip/discord-Fosshost.bad-urls.txt
23:44:43 <h2ibot> TheTechRobo: Fixed 2 unprintable URLs: https://transfer.archivete.am/SFBn/discord-Fosshost.not-printable.txt
23:44:44 <h2ibot> TheTechRobo: Deduplicating and queuing 8846 items.
23:44:45 <h2ibot> TheTechRobo: Deduplicated and queued 8846 items.
23:45:10 <TheTechRobo> qwertyasdfuiopghjkl: ^