-
Doranwen
I love how the postgres documentation says it supports collation for indexes but doesn't provide any info on what that actually IS
-
» Doranwen doesn't even know if she needs an index, but is suspecting she might, given that there are over a million records in this database and there are cases where the name column might need to be compared to one in another table of nearly as many records…
-
Doranwen
pgadmin is pretty clear about how to set up an index, at least - if I can figure out which options I need, lol
-
thuban
the rule of thumb i was taught is that if you will often need to select less than 10% of the records from a table, you should index the column(s) you're selecting on. this kind of 'name' setup is a pretty classic example
-
Doranwen
yeah, definitely would need it
-
Doranwen
the collation option confused me
-
Doranwen
also I had no idea about the fill factor
-
Doranwen
or whether I should cluster the table, lol
-
Doranwen
so many options!
-
Doranwen
it does not explain them
-
» Doranwen should know this stuff, apparently
-
Doranwen
and I have to select an operator class but that seems fairly straightforward - text column, so text_pattern_ops
-
thuban
respectively: don't worry about it, don't worry about it unless you know you're going to be doing a lot of updates (and set it back to default when you're done), and not unless you know you're going to be doing a lot of range-based selections (so in this case no)
-
Doranwen
ah, so don't pick an operator class, let it go with the default?
-
Doranwen
I kind of *have* to pick one, actually
-
thuban
the default should be text_ops
-
Doranwen
hmm, text_ops isn't an option
-
Doranwen
there's six options
-
Doranwen
only text_pattern_ops has "text" in it
-
Doranwen
I can try leaving blank
-
Doranwen
see if it'll let me go with that
-
Doranwen
collation options look like a horde of language specs and at the top C, C.UTF-8, and POSIX
-
Doranwen
I'm guessing UTF-8
-
thuban
yes, it has to do with sort order
-
Doranwen
yeah, I'm sort of figuring that
-
Doranwen
was about to start trying to see how they sort and get an idea
-
Doranwen
though I'm not sure what C by itself is
-
Doranwen
and I don't think searching for that will be very effective
-
thuban
-
Doranwen
ahhhh
-
» Doranwen goes to read
-
Doranwen
I know what a locale is but that wasn't coming to mind when I looked at that list
-
thuban
seriously though, you should not worry about it. if pgadmin's interface makes you specify everything for some reason, use the console to create it in sql and let postgres choose the defaults; it's as simple as `create index <name> on <table> (<column(s)>)`
-
Doranwen
LOL, Stackexchange question about the collations - first line of reply: "The PostgreSQL documentation leaves a lot to be desired (just sayin' 😼 )."
-
Doranwen
ok, thanks for that - that helps a lot
-
Doranwen
I'm going to get these indices built and test pulling some data and then I should leave it for the night, lol
-
ParkerR
Holy moly. Just went on a rabbit hole of Wait Wait NPR episodes that led me to their old download server still being alive
gist.github.com/7eefa965f1ad1c70c0941554127d5e28
-
ParkerR
2000-2005 is uploading to archive.org as we speak
-
thuban
nice :D
-
ParkerR
Bunch of looking at the handful of archived webpages and guessing the URL schemes, finding nested playlist links, etc
-
ParkerR
To their credit it was all on the same server. Pain is they dont do directory listing
-
ParkerR
That'd be too easy
-
ParkerR
I used some bash expansion and wget to scrape it all. Thankfully the abundance of 404 requests was outweighed by get url list only using a single connection per attempt
-
ParkerR
*wget
-
ParkerR
Realized I missed some multi part files (things with 01 in them) but here's the initial page
archive.org/details/wait-wait-2000-2005
-
ParkerR
Got the missing downloaded just waiting for processing to clear before adding the rest
-
asie
The Polish pre-Facebook social media platform focused on schools and universities, Nasza-Klasa, is shutting down today
-
asie
nk.pl - might be worth running a job on it
-
asie
except it's too big to
-
ArchivalEfforts
asie Archivebot is already running on it, but won't finish
-
ArchivalEfforts
-
JackeithWelley
I like all those archiveteam domains
-
DogsRNice
-
DogsRNice
might be worth archiving content related to arthur
-
EggplantN
fionera: hmmmmmmmmmmmmm
-
EggplantN
fus l just showed me your cursed shit
-
Frogging101
?
-
AK
Don't worry Frogging101, it's probably something weird
-
arkiver
most definitely*
-
AK
EggplantN, thought's on Hawkes Urban Orchard?
-
Kaz
i had a can once
-
Kaz
i don't think it was terrible, but it's been a while
-
AK
It's probably my new favourite drink tbh, fully expecting to be shamed for that though haha
-
EggplantN
Never tried AK I always just brew it instead
-
EggplantN
Tons cheaper and tastes better
-
AK
That makes sense, I do want to try brewing at some point
-
fionera
EggplantN: thats not curse
-
fionera
d