03:59:53 I love how the postgres documentation says it supports collation for indexes but doesn't provide any info on what that actually IS 04:00:50 * Doranwen doesn't even know if she needs an index, but is suspecting she might, given that there are over a million records in this database and there are cases where the name column might need to be compared to one in another table of nearly as many recordsā€¦ 04:01:47 pgadmin is pretty clear about how to set up an index, at least - if I can figure out which options I need, lol 04:20:58 the rule of thumb i was taught is that if you will often need to select less than 10% of the records from a table, you should index the column(s) you're selecting on. this kind of 'name' setup is a pretty classic example 04:21:54 yeah, definitely would need it 04:22:09 the collation option confused me 04:24:02 also I had no idea about the fill factor 04:24:44 or whether I should cluster the table, lol 04:24:47 so many options! 04:24:50 it does not explain them 04:24:58 * Doranwen should know this stuff, apparently 04:26:55 and I have to select an operator class but that seems fairly straightforward - text column, so text_pattern_ops 04:28:49 respectively: don't worry about it, don't worry about it unless you know you're going to be doing a lot of updates (and set it back to default when you're done), and not unless you know you're going to be doing a lot of range-based selections (so in this case no) 04:29:13 ah, so don't pick an operator class, let it go with the default? 04:29:28 I kind of *have* to pick one, actually 04:29:43 the default should be text_ops 04:30:02 hmm, text_ops isn't an option 04:30:05 there's six options 04:30:12 only text_pattern_ops has "text" in it 04:30:22 I can try leaving blank 04:30:27 see if it'll let me go with that 04:30:53 collation options look like a horde of language specs and at the top C, C.UTF-8, and POSIX 04:31:19 I'm guessing UTF-8 04:31:21 yes, it has to do with sort order 04:31:29 yeah, I'm sort of figuring that 04:31:42 was about to start trying to see how they sort and get an idea 04:31:56 though I'm not sure what C by itself is 04:32:03 and I don't think searching for that will be very effective 04:32:54 https://wiki.debian.org/Locale 04:33:00 ahhhh 04:33:04 * Doranwen goes to read 04:33:23 I know what a locale is but that wasn't coming to mind when I looked at that list 04:36:32 seriously though, you should not worry about it. if pgadmin's interface makes you specify everything for some reason, use the console to create it in sql and let postgres choose the defaults; it's as simple as `create index on ()` 04:36:49 LOL, Stackexchange question about the collations - first line of reply: "The PostgreSQL documentation leaves a lot to be desired (just sayin' šŸ˜¼ )." 04:38:50 ok, thanks for that - that helps a lot 04:41:14 I'm going to get these indices built and test pulling some data and then I should leave it for the night, lol 06:30:30 Holy moly. Just went on a rabbit hole of Wait Wait NPR episodes that led me to their old download server still being alive https://gist.github.com/7eefa965f1ad1c70c0941554127d5e28 07:05:04 2000-2005 is uploading to archive.org as we speak 07:09:02 nice :D 07:10:28 Bunch of looking at the handful of archived webpages and guessing the URL schemes, finding nested playlist links, etc 07:10:58 To their credit it was all on the same server. Pain is they dont do directory listing 07:11:08 That'd be too easy 07:13:05 I used some bash expansion and wget to scrape it all. Thankfully the abundance of 404 requests was outweighed by get url list only using a single connection per attempt 07:13:13 *wget 08:01:18 Realized I missed some multi part files (things with 01 in them) but here's the initial page https://archive.org/details/wait-wait-2000-2005 08:01:40 Got the missing downloaded just waiting for processing to clear before adding the rest 08:20:03 The Polish pre-Facebook social media platform focused on schools and universities, Nasza-Klasa, is shutting down today 08:20:24 https://nk.pl/ - might be worth running a job on it 08:20:37 except it's too big to 08:40:45 asie Archivebot is already running on it, but won't finish 08:40:54 http://dashboard.at.ninjawedding.org/3/?showNicks=1 12:00:25 I like all those archiveteam domains 19:21:27 https://twitter.com/BabyLamb5/status/1420064893395365889?s=20 19:21:56 might be worth archiving content related to arthur 20:08:07 fionera: hmmmmmmmmmmmmm 20:08:15 fus l just showed me your cursed shit 20:21:17 ? 20:39:02 Don't worry Frogging101, it's probably something weird 20:39:17 most definitely* 20:39:37 EggplantN, thought's on Hawkes Urban Orchard? 20:42:13 i had a can once 20:42:36 i don't think it was terrible, but it's been a while 20:48:40 It's probably my new favourite drink tbh, fully expecting to be shamed for that though haha 20:57:28 Never tried AK I always just brew it instead 20:57:34 Tons cheaper and tastes better 21:30:50 That makes sense, I do want to try brewing at some point 21:49:06 EggplantN: thats not curse 21:49:07 d