01:38:35 emerald: If the goal is to get the content on IA, I think it would probably be simpler to use tubeup: https://github.com/bibanon/tubeup 01:39:16 However, IA isn't a big fan of large/mindless youtube dumping, so please be mindful 01:43:36 (tubeup is also mentioned in the section directly above the section you linked) 05:43:41 jodizzle: I was looking at tubeup, but it appears I can't use it to upload videos I've fetched already? Unfortunately the channel in question has been purged already 05:47:59 emerald: Ah, I see. You probably could get tubeup to work in some capacity, but I think you'd have to hack it a bit. 05:48:27 ah, in that case i'll fork the repo and get hacking i suppose 05:49:39 Might not be worth it. I think what the wiki recommends for manual upload is good: basically upload everything you got out saving the videos, including metadata. 05:50:13 Looking at the tubeup source could still be good for figuring out how to set IA item metadata, though 05:51:30 And how it uses the internetarchive python library to automate the creation of a lot of items 12:39:14 EggplantN, I think you confused me with someone else 12:39:35 I did not :) 12:39:57 Well, I didn't re-ask questions that had already been answered 12:40:54 Namely the concurrent you did 12:40:58 Sometimes staff would give contradictory (exact opposite) answers and I would ask for clarification, but I didn't just ask the same question more than once 12:41:32 I only asked that once based on the math that redlizard did 12:42:12 It is in the topic, for a reason :) 12:42:12 Either way we try to be as helpful as possible, we have wiki's topics etc to try and avoid a lot of questions 12:42:55 redlizard was arguing we were underutilizing our compute by orders of magnitude and could accelerate our archiving massively within the limited window we had 12:43:01 seemed worth exploring 12:43:14 I read the wikis and topics and didn't ask basic questions that were covered there 12:43:21 in what way? we were limited by yahoo's servers a majority of the time? 12:43:36 And we made that apparent all of the time. 12:43:50 We occasionally had times where additional compute could have helped but mostly not 12:44:10 It was an in-depth technical discussion 12:44:22 You can go revisit the logs if you want 12:44:27 yahoo: fucking it up even in death 12:44:36 (seriously verizon come on) 12:44:37 If you don't have a copy, I can send you one 12:44:47 The issue was yarrow we already knew what we could and couldn't do. 12:44:58 Well, why not just say that? 12:44:58 We had tested extensively and run on going checks 12:45:03 We did 12:45:07 Not to me 12:45:08 by having it in the topic 12:45:17 the topic didn't say that 12:45:18 Trust us, we know what we're doing ;) 12:45:23 it said 5/IP 12:45:29 its because we found that 5/IP was the max 12:45:34 through our testing and checks 12:45:42 yeah, but it didn't say you did ongoing testing 12:46:06 as I recall, you said redlizard might have had a point 12:46:09 but my question is, how would have upping the amount per IP increased our archiving if we were already at yahoos server limits 12:47:23 either way, my views still stand. We need help and we're all busy people. Replying with "69.420%" isn't help ;) pinging 3 OPs at like 3-4am to ask a question thats in the topic isn't helping. 12:47:23 We appreciate every bit of help we get, as long as it is help :) 12:57:01 https://www.irccloud.com/pastebin/vNh3ZD0G/%23noanswers%20log%202021-05-01 12:57:52 specifically: 12:57:59 [2021-05-01 17:53:37] So I figured, if we raise the speed on those invalid 404s, we will get more invalid 404s, but we might still get more total successful kids. 12:57:59 [2021-05-01 17:54:04] Thus, >testing if yahoo can handle a higher kid rate 12:57:59 [2021-05-01 17:54:36] interesting, for now i'm fairly happy how it is plus i'm about to need bed but i will look into tomorrow morning possibly 12:58:18 yes you did not give me chance to look before asking either 12:58:30 we did also do changes similar to that 12:58:31 what? 12:58:38 we moved all kid items to a private queue 12:59:09 after red lizard suggested this? 13:00:13 after I said "interesting, for now i'm fairly happy how it is plus i'm about to need bed but i will look into tomorrow morning possibly" 13:00:13 we looked into it and decided that IF we could increase it we would like it to be ran by those who we could easily ask them to change their concurrents 13:00:24 So people with orchestration we asked to contribute there 13:00:31 I know you were running all your VMs by hand 13:00:47 so, it wasn't true that you "already knew what we could and couldn't do." 13:01:03 you had to test it 13:01:40 you had to look into it and see what was possible/effective 13:01:53 the question was NOT already answered 13:02:10 We did know what was possible at that time. 13:02:15 We didn't go harder than 5/IP 13:02:22 even once moved to private 13:02:33 because it wouldnt work but in case it did, we prepared for it 13:03:10 the bottom line is redlizard made a suggestion that you hadn't thought of and had to test after they suggested it to see if it would work well 13:04:00 that's not an example of something asking an obvious question that's already answered in the topic 13:04:22 that's something making a sophisticated suggestion that you decided was worth testing 13:04:30 *someone (not something) 13:05:01 on another topic, if you don't want people to make jokes, you should put in the topic "don't make jokes" or otherwise tell people not to make jokes 13:05:03 we hadn't thought of testing per item rate limits because that isn't possible for us to do for end users with how seesaw-kit and pipeline.py works, that alongside redis hands items out randomly we could only do this with a whole new queue/project. So we weren't going to test it due to how complicated it is. 13:05:07 yarrow 13:05:14 please, lets finish this up 13:05:16 like I said 13:05:24 we're busy people I have work to do, and archiving to do 13:06:01 I would just suggest you step back from community management tasks and stick to technical tasks 13:06:11 because your approach to community management is damaging 13:06:51 it isn't emotionally competent 13:06:52 look i'm new here but my two cents is maybe the best way to do feedback isn't insulting a mod 13:07:39 it's not an insult, it's just very frank feedback. 13:07:48 eggplantn gave real, valid reasons why it didn't happen from what i can see 13:08:05 people have different skillsets appropriate to different kinds of roles in a volunteer organization 13:08:22 allie_signet, you are missing a lot of context 13:08:42 Yeah, like I said we're doing our best, we try our hardest and its at times like this when yourself and serx try to make us feel bad about the work we do for free it is really quite sad. 13:08:44 yeah, i am, that's why it's two cents and not a dollar 13:09:13 I'm not mad about staff decided to test or not test certain ideas. I'm mad about staff being overtly hostile toward volunteers 13:09:16 Either way, please drop this and continue to contribute or not. 13:09:32 I donI'm not trying to make 13:09:36 We really thank those who help out 13:11:05 *I don't know anything about what serx said or did. I'm not trying to make you feel bad about the work you do. I'm just pointing out how your behaviour was hurtful to me in this context and how this sort of behaviour can be damaging to a volunteer community by creating a hostile, unfun atmosphere rather than a fun, welcoming, friendly one. 13:11:44 Outsider volunteers like myself are also doing work for free and spending money contributing to projects. We are volunteers who deserve the same respect and decency that you do. 13:11:47 Please, drop this 13:11:49 We have work to do 13:14:39 If you have expectations for volunteers' behaviour that are not being met, it can go a long way simply writing a short list of rules or guidelines, such as: 1) Don't ping mods (optionally: within the hours of X to Y UTC) unless it's an emergency, 2) Don't give joke answers to questions, 3) etc. If you don't communicate this stuff, people aren't mind readers and will have no idea what will make you mad or not. 13:15:13 urgh wrong button 13:18:41 I've reached out in DM, he can discuss me all he likes there. 13:52:36 fwiw: i found yarrow's repeated questions disruptive, and said so, well before the 'can we try 100 concurrent' and eventual kicking. no mind reading was necessary. 13:53:18 (because i value the work archiveteam does despite my limited engagement with its technical infra, i try to be exceptionally patient and helpful in chat... but part of "community management" is keeping the community congenial to the people already in it. if i was put off, how much worse for the ops receiving repeated pings for redundant questions while trying to manage the 13:53:20 project! and that's a load-bearing effort.) 13:56:19 You said it much better than I can say it myself 13:56:37 Especially when the more people that ask and do stupid things, simply slow us down 14:17:19 Hi, jokers. 14:18:04 I see Yarrow decided to YOLO into the history books. 14:20:38 It seems so. Anyway hello! How is you 14:21:01 Got called a Nazi on twitter, responded disproportionately. 14:21:31 Can I expect a letter from yarrow in the next 2-3 days stating his position? 14:22:13 I would hope so, he is still in -bs 14:24:39 What's the backstory on yarrow. I don't know how long they've been with the project. 14:25:24 When I see terminology like "Your actions are not emotionally competent", I have a strong feeling they exist to Karen out everyone's time, for sure. 14:25:41 < yarrow> it's not an insult, it's just very frank feedback. 14:25:45 I need to use this more often. 14:26:00 * SketchTheCow gives your mom some frank feedback 14:27:58 (First time I saw yarrow was during the 2021 yahoo answers project.) 14:29:26 That is where he has come from 14:31:24 Just getting a grip on the situation. So he came in, had Some Extra Ideas, demanded life take the lemons back, talked shit, got hit, and then came to the world's most amazing, court of last resort, #archiveteam-ot, to show off his boy scout download badge and ranking and try to get the Eggplant fired? 14:37:13 I think thats pretty much it, wanna bitch about me, please do it in DM. 14:37:17 I'm happy to hear it 14:38:19 I mean, you've probably been a dick the whole way through, but that's my technique as well, so you tearfully going "I LEARNED IT BY WATCHING YOU" isn't going to be a big surprise. 14:39:04 I get he wanted to switch horsemen mid-apocalypse, and come up with additional ways to acquire data and optimize, but we had a pretty good run 14:40:54 can you blame people for being dicks when every other day is a non-negotiable deadline? 14:41:27 Oh you can talk to my girlfriend 14:48:24 Hi! 14:48:33 Is this the Anime club? 14:49:16 To add to the yarrow situation it's not clear to me what lead to the ban since there was little activity from yarrow between their kick and ultimate ban, but maybe it was supposed to be a ban in the first place. Other than that I think that summary is accurate. 14:52:22 spirit: Да, вы пытаетесь пропатчить KDE2 под FreeBSD? 14:53:34 til how to spell smegma princess in kyrillic 14:53:55 lol 15:03:33 I was talking to the elusive JeffN on Discord and he said that we require registration for Tor users to access project channels. Is that accurate? 15:33:03 possibly. I remember there were some issues with tor users at some point? 15:35:37 wasn't there a supposed tor user in #microscope a while ago? 15:35:53 He was saying that something with Hackint's services were giving him issues registering an account as well. I'm really just curious for my own information more than anything. 15:38:02 yeah, so checking #archiveteam, unregistered tor users are banned, presumably for some sort of abuse coming from it. any idea what the issue with registering was? 15:38:46 "I can't get in those channels anymore, you don't like tor/anonymity and hackints services are borked so I can't register." 15:38:52 That's what he posted 15:40:11 They were having a discussion about archiving LiveLeak in Jason's channel on The-Eye Discord, and I was directing them to the project channel, and that's what he replied with 15:51:28 I didn't do the ban, but I believe someone was abusing it to spam or bypassing a ban. I just tried to signup for a hackint account 'anonymously' with the instructions and it appeared to work. https://www.hackint.org/transport/tor#Anonymous_Account_Registration 15:53:15 Yeah, we find Tor a huge pain in the ass, sorry 15:54:58 Makes sense. I just hadn't realized that restriction was in place. And for registration, he probably tried it once, had an issue, and never went back. 16:04:48 Tor deserves the reputation 18:18:56 https://ped.ro/blog/code-blocks-but-better 18:49:32 why dont more site have rsync capabilities 18:49:43 take for example, thetrove.is 18:49:54 tons of rpg books in pdf format, most are OOP 18:50:09 why dont have an rsync endpoint so people can help you archive 18:53:21 Looks easily scrapable though 18:53:36 Much easier than many others 18:55:00 oh it is 18:55:08 with right wget params 18:55:25 but still, rsync server would be so much easier, send up bw limits and everything 18:55:40 plus when theres updates, you can just nab the deltas 18:55:41 Heck, I'd say you could just throw it into grab-site or archivebot and it'd just work :tm: 18:55:56 eh, its a lot of data for grab-site or archivebot 18:56:11 SO IF ANYONE HOARDS TABLETOP RPG BOOKS 18:56:15 hmu 18:56:18 hahahah 19:17:17 Craigle: Yes, that's accurate. If there are issues with the anonymous registration, they should bring that up in #hackint. 19:21:04 Thanks for the confirmation JAA. I hadn't really thought about it previously, but it obviously makes sense to block unregistered Tor access. And agreed, Hackint issues are not AT issues. 19:44:52 jodizzle: AB did a *beautiful* job with pemberley.com - got every single one of the stories buried in that stupid JSON table, along with some stuff that *wasn't* in there. 22:44:27 Streisand is now in effect. 22:44:36 What? 22:44:37 oh lord yes 22:44:56 What is "Streisand"? 22:45:10 Barbara? 22:45:13 are you new to the internet? 22:45:17 just curious 22:45:31 because its implied that all IRC channels are logged by someone 22:45:33 I'm not new to the internet. 22:45:38 just like everything on discord is logged 22:45:44 The Streisand Effect. Barbara Streisand got pissed someone posted picture of her house to the internet, and sued to have them taken off the internet. So they became the most popular pictures on the internet. 22:45:56 https://en.wikipedia.org/wiki/Streisand_effect 22:46:04 Oh the Streisand Effect. 22:46:05 thats the price you pay when you discuss on public accessable places, like this one 22:46:25 No, I'm not new to the internet, not at all. 22:46:29 if you want convo's to be private, you either encrypt your conversation, or use a server that you control 100% 22:46:30 Somehow I doubt that you believe me. 22:46:41 I have heard of that effect. 22:47:05 and although your connected to the irc server is encrypted, you're assuming the connections between all the servers in the network are encrypted 22:47:18 hence the R in IRC 22:47:26 If you want a private conversation, you talk to yourself. 22:47:28 I'm assuming nobody is some creep who records everything I say. 22:47:45 Yet apparently such people are omnipresent? 22:47:50 Virtually all chat software records all messages. 22:47:59 * arkiver logs everything 22:48:01 you're welcome 22:48:07 heh i do too 22:48:10 There are ones that claim to have 'disappearing' messages, but that's bullshit. 22:48:21 Why even use such services then? 22:48:25 why? 22:48:27 Why webchat at all? 22:48:28 JAA: hah thats funny 22:48:30 My irc client logs all messages, only so I can see them whenever I want 22:48:31 Don't post to the internet what you don't want other people to see and potentially keep a record of. 22:48:35 yup 22:48:43 anonymous: you're free to use your own irc client, you know 22:48:49 You should assume any conversation you have in a public space is being recorded or otherwise preserved. 22:48:52 How much money does it cost? 22:48:57 $0 22:48:58 completely free 22:49:09 >You should assume any conversation you have in a public space is being recorded or otherwise preserved. 22:49:26 you should assume everything you do on the internet is recorded 22:49:31 because 99.9% of servers have logs 22:49:45 Why do they have logs? 22:49:53 For several reasons 22:49:54 Generally for monitoring 22:49:57 monitoring 22:50:01 diagnosting 22:50:05 monitoring, or because they're required to by law 22:50:10 preventing denial of service attacks 22:50:14 law, the list goes on and on and on 22:50:15 Monitoring is not the same as recording. 22:50:32 so someone can monitor this cahnnel say from the FBI/NSA/etc 22:50:34 ጠӋ ṃƎṦȿɐġΈչ ἂɍḘ ṔṜȱṯξḈțēÐ ʙƴ ṦԵґὫᾖԌ ËӆÇřφϤṪıộἦ. 22:50:42 oh snap im stealing that 22:50:46 lol 22:50:54 Looks like standard Zalgotext to me. 22:51:01 Recording means I can monitor and look at what is going on later 22:51:08 im sorta surprised this fact is new to you 22:51:10 I don't need to be watching 24/7 to see what's happening 22:51:13 Oh no, our evil plan is foiled! 22:51:17 nooooo 22:51:23 JAA is really... NSA 22:51:25 (Insert xkcd 538) 22:51:27 hahaha 22:51:32 Yes, recording means monitoring of the past present. 22:51:36 can confirm 22:51:51 No monitoring of the future? That's sad. 22:51:59 you guys dont have logs from the future? 22:52:15 wpull needs time travel support! 22:52:23 arkiver can code that in lua 22:52:25 i have faith 22:52:42 now the advantage of IRC is that you cant log if you arent here 22:52:46 unlike discord 22:52:46 I'm sure he can, but then it's in Lua. 22:52:56 Is degeneration into sarcasm natural in internet communities, or is it done specifically to tease those secretly deemed idiots? 22:52:57 which keeps a preputal searchable log 22:53:02 We need to develop an AI that generates predictive logs, like AI that generates predictive lyrics and melody. 22:53:12 okay so you're new to the internet 22:53:16 the internet runs on 2 things 22:53:18 1. Sarcasm 22:53:19 2. Porn 22:53:22 thats it 22:53:43 don't forget the people that archive the sarcasm and porn 22:53:44 What did you expect when asking the same question over and over? 22:53:44 if I pull my logs from the late 90's, i will find sarcasm, and porn 22:53:59 I'm not new to the internet, but bragging about my internet prowess would only make me seem even newer. 22:54:07 So how do I resolve this situation? 22:54:19 ARPANET was created for distributing porn, wasn't it? :-) 22:54:23 Hiding my powerlevel has had unintentional consequences. 22:54:23 if I pull my logs from the late 90's, i will find sarcasm, and porn / you have just invented bash.org 22:54:51 What about sarcastic porn? 22:55:06 * SCSi puts on his wizard hat 22:55:08 anonymous: by not getting upset on the internet, under any circumstance. it's a sign of weakness and easy meat. 22:55:29 but you're from the internet, so you already know this. 22:55:30 You mean I should be the upsetter? 22:55:48 nah, you're amusing at this point 22:55:50 >but you're from the internet, so you already know this. 22:56:08 STOP LOGGING MY CHATZ 22:56:10 I lurk except in places where archives are less obvious. 22:56:13 holys hit 22:56:16 he's logging? 22:56:19 yeah 22:56:21 i know right 22:56:31 So I assume it's not archived because I want to have some sort of internet social interaction. 22:56:32 oh damn, he's going to find out my porn habits 22:56:33 it's easy just type like **********************************8 22:56:34 SCSi: Can I blow your mind? 22:56:40 nyany: plz do 22:56:41 see, secret? 22:56:43 I'm logging too 22:56:46 holy shit 22:56:47 If I was completely honest with myself, I would lurk 100%. 22:56:51 no one can see it it's encrypted :) 22:56:57 does my password of hunter2 show up as ******* to you? 22:56:59 or just me 22:57:06 ******* here 22:57:10 okay good 22:57:17 it shows up as hunter2 here 22:57:17 you're such a voyeur. pervert! 22:57:20 This is a severely unfunny situation. 22:57:24 why? 22:57:31 Secr3tlyAP0rnst4R!^ 22:57:32 you have once again invented bash.org 22:57:44 hey, why can I see my password 22:57:53 oh it just hides it from other people 22:57:53 It's unfunny because of the predictive and repetitive attempts at "humor". 22:58:01 you know so that you can see it if you need 22:58:25 And because I'm being treated like an idiot and trying to be fooled into revealing my IRC password. 22:58:34 do you 22:58:37 My password honestly is 1234 22:58:38 do you even have an irc password 22:58:40 oh my god 22:58:42 Either that or I'm misreading the situation with my non-existent social skils. 22:58:45 *skills 22:58:58 >do you even have an irc password 22:58:58 you're one of today's lucky 10 thousand! 22:58:59 The lounge forced me to set a password, so I went for 1234 22:59:09 >10 22:59:10 http://bash.org/?244321 22:59:11 >thousand 22:59:16 Numbers or words, choose. 22:59:20 no :) 22:59:27 choosing is hard. 22:59:32 being non-binary means i don't have to choose ;) 22:59:51 That doesn't apply here. 22:59:58 Choosing nothing is still a choice. 23:00:04 There's an expression for this. 23:00:15 Hobson's choice. 23:00:40 You know anonymous your IP is public on IRC. If you’re concerned about privacy I’d deffo enable a hostname :) 23:01:10 Your smile emoji is misplaced. 23:01:21 emoticon 23:01:21 You give me a crisis, and smile? 23:01:29 >emoticon 23:01:31 false 23:01:34 I smile in the sight of pain :) 23:01:36 :(: 23:01:38 : ) is an emoticon 23:01:45 I'm seeing yellow, that's an emoji. 23:01:46 so is :/ 23:01:55 oh, you're using a cheezy client that replaces emoticon with stickers 23:01:59 :<:>: 23:02:02 that'll be your client 23:02:05 looool 23:02:07 next thing you'll tell me is roses are red and violets are blue and pineapples belong on pizza 23:02:09 😂🅱️🎂📈😀🎈👀👀👀🍻🅱️🇰🇵🇰🇵🇰🇵🅱️🅱️🅱️ 23:02:16 god that's horrific 23:02:20 fucking hell EggplantN 23:02:20 nyany: watch it son! 23:02:22 >oh, you're using a cheezy client that replaces emoticon with stickers 23:02:25 weechat doesn't like that 23:02:34 🍌 23:02:35 I just chose a username 23:02:39 Thelounge loves it 23:02:40 and logged on 23:02:48 teehee 23:02:55 SCSi, that was some good popcorn. 23:02:57 https://irc.fu.is/uploads/417e2004c2f12e34/9A9E8787-7A5A-4446-8A27-73A47E78B411.png 23:02:59 poor anonymous 23:03:04 ? 23:03:09 What happen? 23:03:16 Sad things 23:03:16 someone set us up the bomb 23:03:17 ¿ 23:03:24 What you say? 23:03:29 JustArchiveThings 23:03:30 is he going to be upset when we can find out where he's from by his IP? 23:03:31 all your base are belong to us XD 23:03:52 Possibly SCSI he could enable hostname :) 23:03:57 AK stands for Archive King, anything I see is archived forever ;) 23:04:06 I have no idea how to "enable hostname". 23:04:14 turn main screen on 23:04:19 EggplantN: https://transfer.archivete.am/Jc3tC/emoji.png 23:04:24 https://www.hackint.org/faq#Can_I_get_a_vhostcloakspoof 23:04:27 Look, if you people are the archive legends, then there's something I want to see. 23:04:33 oh my 23:04:38 It's very important. 23:04:44 anonymous: what's that, now 23:04:47 What do you want to see. It’s 9inchs I must warn you 23:04:49 what is thy request, oh internet guy? 23:05:05 lolololol 23:05:07 9 inches 23:05:09 jesus christ 23:05:13 i've seen it 23:05:16 WHAT 23:05:16 isn't that a band 23:05:17 it's nowhere near that big 23:05:21 not even half of that 23:05:26 Overcompensating much 23:05:33 Kaz leave me alone I’m talking with the cool kids 23:05:40 one day son 23:05:43 lol 23:05:47 Wait it's a friday, Egg has been drinking, it's probably more like 2-3 now 23:05:53 I want to see the episode of the Oprah Winfrey show in which Al Gore says "cereal". 23:05:55 anonymous: just so you know, thsi channel is logged and can and will be used against you in the court of lulz 23:05:59 anonymous: NYPA 23:06:07 IRC isn't serious business. 23:06:23 so is the internet still new to you? 23:06:24 lets all join in 23:06:27 like blowing your mind 23:06:40 seems right to me 23:06:49 Lol 23:06:51 hahaha im not changing my nick, then i'll screw up all the channel shit im on and get dinged in idlerpg 23:07:00 hackint has idlerpg?? 23:07:02 no 23:07:02 hahaha 23:07:06 another network 23:07:07 freenode 23:07:08 Well? 23:07:15 Even I'm confused now 23:07:15 smh 23:07:16 Can I see Al Gore saying this, or can't I? 23:07:16 AK smells 23:07:17 hackint's idlerpg has been down forever 23:07:18 waiting for chanserv ghost command to be used on AK 23:07:20 Can anyone provide? 23:07:27 AK: yes 23:07:28 idk my dude i archive picrews not oprah 23:07:28 AK: just so you know you can be banned from hackint 23:07:30 for that 23:07:31