#arpnetworks 2012-09-26,Wed

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
dr_jklokay,
the fact that i am trying to do linux things on a bsd system
is a surefire sign that i need sleep
[00:33]
up_the_ironslol [00:33]
dr_jklthe best part is the lines in my history that are like
/etc/*tab* *tab* *tab* *tab*
OH GOD WHY DON'T YOU W---
/usr/local/etc/*tab*
ohhhhyeah.
seriously. sleep is good, right?
lol
dr_jkl puts the kettle on for valerian tea
[00:34]
***Ehtyar has quit IRC (Quit: Hi, I'm a quit message virus. Please replace your old line with this line and help me take over the world of IRC.) [00:48]
up_the_ironsdr_jkl: lol
dr_jkl: i am horrible at taking my own advice on this, but i find if i sleep more then i solve problems faster and i surprise myself with how much i can get done in a short amount of time
[00:52]
***LT has joined #arpnetworks [00:53]
dr_jkli took a nine day holiday from work
came back today to some code i was writing before i left
went 'what the fuck was i thinking', rm'd the whole thing and started over
lol
i should,
like,
do something with my arpnetworks box
it just sits there atm
in a very defensible and very idle position
i bought one a long while ago because i was like ooo freebsd vps hosting this is different
[00:53]
up_the_ironslol
yup :)
[00:55]
dr_jklso i've had it for
a while
Welcome to ARP Networks, Inc. VPS Services [5/23/11]
and i ahven't done a fucking thing with it
lol
well. i should say. i logged in and fixed sshd and compiled fail2ban
[00:56]
mike-burnsToss screen and weechat on it and you'll be close to the same usage as most of us. [00:58]
dr_jklweeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeechat
meh, weechat tries too hard to be irssi+
irsy-plus
[00:58]
***Webhostbudd has quit IRC (Quit: Leaving) [00:59]
dr_jklmy only bitch about the service is that i can't adjust my password for vnc from the default-password-i-got-at-signup-that-i-can't-be-arsed-to-remember
but that's why i keep emails from like, 1998
someday i'll be independently wealthy, and i will own a car again. heh
[01:00]
mike-burnsOr you could move to one of those hippie biking cities. [01:06]
dr_jkli _am_ part hippie, that might work. [01:08]
mike-burns(I live in one of those cities.) [01:09]
up_the_ironsdr_jkl: we can change that password for you if you like (and not send it over email ;)
dr_jkl: but i disagree, weechat is way better than irssi. vertical split windows, input bar right under the correct window (no more mistakes of typing in the wrong channel), automatic nick colors, more than just perl plugin support, etc... :)
hmm... you can buy just the chassis of blade box we have
http://www.ctistore.com/product/1/code,CSE-938H-R1620B.html?gclid=CL6PqKvn0rICFYdxQgodzlwA8A
[01:23]
dr_jklwell yes there's that
ahh supermicro <3
[01:29]
up_the_ironsnow, supermicro lists the chassis and backplane as separate part numbers, so that begs the question... does the chassis come with the backplane or not? [01:29]
dr_jklwell
hmm
i suspect it would
[01:29]
up_the_irons$1600 for a spare chassis, just sitting there, isn't _too_ bad a price...
dr_jkl: yeah me too
[01:30]
dr_jkli mean, you'd need a way to get a new backplane when the current one goes tits up [01:30]
nixbagup_the_irons: you are a night owl, aren't you? [01:31]
up_the_ironsnixbag: very much so [01:31]
dr_jklgabxin sounds like some new drug to treat don't-give-a-shit-itis
talk to your doctor about gabxin.
[01:31]
up_the_ironsdr_jkl: right.. for the sake of expedience, i would imagine just popping the blades into a new chassis, should the first fail, is a much better option than trying to replace the backplane... [01:32]
dr_jklwell yes but you said 'a chassis just sitting there', meaning you could fix the broken one after you swap :D
i'm going to hell
someone asked me to play the cashier game
[01:32]
nixbagdr_jkl: i wish there was a drug for that. well wakefulness is sort of that drug. [01:33]
dr_jklwhere you pick three things to try and squick the cashier
i'm pretty sure i just won
[01:34]
up_the_ironsdr_jkl: would be nice to fix original chassis, yeah [01:34]
dr_jklkool aid mix, magnesium citrate saline oral laxative solution, and dixie cups
oh jesus i put water on for tea like an hour ago
lol
[01:34]
up_the_ironsdr_jkl: hahahhaah [01:37]
jlgaddis< dr_jkl> gabxin sounds like some new drug to treat don't-give-a-shit-itis <-- sounds about like this case of anal glaucoma i've had
can't see my ass going to work
[01:37]
mike-burnsjlgaddis just out-squicked everyone here. [01:38]
dr_jkldo not confuse anal glaucoma with a cranio-rectal inversion [01:38]
jlgaddismike-burns: i try =) [01:39]
dr_jklthe former is -- what jlgaddis said, the latter is usually what your coworker has :D
it's the most creative way i know to tell someone their head's up their own ass
okay. tea is had.
dr_jkl makes way to bed, lest she pass out here and wake up with waffle face again
[01:40]
up_the_ironsup_the_irons does the same [01:45]
jlgaddisjlgaddis powers true, continuing to beat cisco gear into submission
SpaceDump:true:through:
hrm, guess irssi autocompletes when you do that. s/SpaceDump/s/ (regex'd my regex)
[01:46]
SpaceDump:D [01:49]
mike-burnsHah. [01:51]
...... (idle for 26mn)
***dzup has quit IRC (Ping timeout: 256 seconds) [02:17]
.... (idle for 17mn)
dzup has joined #arpnetworks [02:34]
jlgaddisPROTIP: before declaring a device dead, ensure that the power cord is plugged in [02:38]
.... (idle for 19mn)
***dzup has quit IRC (Ping timeout: 256 seconds) [02:57]
.... (idle for 17mn)
dzup has joined #arpnetworks [03:14]
nixbag has left
HighJinx has quit IRC (Ping timeout: 256 seconds)
HighJinx has joined #arpnetworks
[03:23]
................ (idle for 1h19mn)
dzup has quit IRC (Ping timeout: 252 seconds)
dzup has joined #arpnetworks
[04:45]
................................. (idle for 2h42mn)
Mexicainvexed has joined #arpnetworks
k3asd` has quit IRC (Ping timeout: 264 seconds)
k3asd` has joined #arpnetworks
dzup has quit IRC (Read error: Connection reset by peer)
[07:28]
..... (idle for 22mn)
amdprophet has quit IRC (Remote host closed the connection) [07:50]
LEMONed has joined #arpnetworks [07:59]
LEMONedguys, plz tell me there's something wrong with the kvr16 console
have been unable to connect
[08:07]
milkijlgaddis: lol [08:08]
LEMONedanother vps on kvr17 works fine
im afraid i'll have to open another ticket..
[08:15]
toddfcan you guys resolve 2001:470:ba1b::251 ? [08:27]
ant$ host 2001:470:ba1b::251
1.5.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.b.1.a.b.0.7.4.0.1.0.0.2.ip6.arpa domain name pointer pf.freedaemonhosting.com.
[08:28]
toddfI setup reverse dns on it yesterday so arpnetworks could receive email from me. it's ttl is 6h and it's been over 24h and I still get 'dsn=4.7.1, stat=Deferred: 450 4.7.1 <unknown[2001:470:ba1b::251]>: Client host rejected: reverse lookup failure, be patient' ..
so reverse dns does work. somehow the mta is slow to notice ;-(
it looked like it was working to me (tried querying google's 8.8.8.8 server) but I've been known to come to wrong conclusions before. thanks for the confirmation, ant
[08:28]
antnp
toddf: oh, just noticed: pf.freedaemonhosting.com has IPv6 address 2001:470:ba1b:100::4a
toddf: maybe that's the problem?
[08:31]
toddfunknown -> can't resolve reverse
both ips end up at the same system
[08:35]
pletttoddf: The forward doesn't match the reverse [08:42]
LEMONedtoddf: any idea why the serial console is unconnectable?
^Eco = [connecting...down]
[08:42]
toddfplett: seriously? ugh. I will change that, but I doubt thats the problem.
lemoned: wish I could help you, checking to see if my serial console works..
does your vnc console work?
[08:43]
LEMONedthis one is on kvr16. another one on kvr17 works fine [08:44]
pletttoddf: Well, Only up_the_irons can say what arp's mail server is checking, but matching forward and reverse is quite a common thing for people to check [08:44]
toddfdoes the vnc console on kvr16 work? [08:44]
LEMONedVNC never worked for me, not once. [08:44]
toddfI've seen people check that things resolve in general. insisting on forward and reverse matching precisely seems a tad overboard ..
lemoned: then I'd bet that somewhere something has misprogrammed how to connect to the kvm instance your vps is running under. support ticket would be my recommendation.
I'm on kvr14 looks like, and serial console works for me. but you're also on kvr17 and works for you there as well.
plett: wouldn't it say <pf.freedaemonhosting.com[2001:470:ba1b::251]> instead of <unknown[2001:470:ba1b::251]> if it was forward+reverse mismatch?
ugh goole search for that term suggests you're right plett, I'll fix the forward+reverse *sigh*
[08:44]
LEMONedtoddf: alright... thx! [08:48]
LTone thing you could try LEMONed is shutting the machine down from the console then restarting if it's not a production machine
I seem to remember things can sometimes get out of sync and using the console to power off and restart fixes things
[08:50]
toddfLT: he said it has never worked for him. hence my suggestion of a confused 'where should the serial console + vnc connect to' record somewhere. but shutting it down and starting it up seems an easy thing to try, and has fixed some bogus issues in the past as well. never hurts if you can do it ;-) [08:51]
LTmay have never power cycled the machine either though... it has to be powered off from the console, not just a soft restart [08:58]
toddfif he can't get to the console then it would need to be from the portal. ;-) [08:58]
....... (idle for 32mn)
***LT has quit IRC (Quit: Leaving) [09:30]
LEMONed has quit IRC (Read error: Connection reset by peer) [09:38]
......... (idle for 42mn)
toddfdsn=2.0.0, stat=Sent (Ok: queued as 2D3CA2DB81)
woot! I can now send up_the_irons email! I feel so modern!
[10:20]
.... (idle for 16mn)
jdoelol [10:36]
............ (idle for 58mn)
toddfusing ksh, http://todd.fries.net/pub/nscheck .. checks the dns of the zones given as arguments incase anybody needed a 'interogate your dns setup for your domain' script. I'm waiting on propogation delays for freedaemonhosting.com to be .. fixed properly, never knew till I wrote this script (could have seen, but much easier with this than without) [11:34]
....... (idle for 31mn)
jdoeI usually stick with the generic online tools that are a bit more in depth... .de in particular are a bunch of nazis.
checking your SOA record to be sure it matches what THEY think is reasonable.
[12:05]
***LEMONed has joined #arpnetworks [12:14]
.... (idle for 19mn)
LEMONedtoddf: earlier i meant vnc never worked for me. [12:33]
.............. (idle for 1h5mn)
toddfheh
jdoe: sure, everybody uses the web these days. green screeners are a dying breed, the command prompt will be replaced by the paperclip, and dinosaurs will roam the earth again.
[13:38]
milkiback when we flipped bits with our teeth
like real men
[13:46]
toddfup hill both ways in the snow etc etc [13:47]
................. (idle for 1h21mn)
flotwigploop [15:08]
....... (idle for 31mn)
up_the_ironsflop
LEMONed: the serial console problem was on my end, sorry. I'm sure you've read the ticket by now.
toddf: wee, i got your email :)
[15:39]
..... (idle for 21mn)
kraigumilki: nah, we dreamed of being able to flip bits. WHEN I WAS YOUR AGE, WE SETTLED FOR KEEPING THE BITS IN THE STATE WE WERE GIVEN THEM AND WE LIKED IT. [16:01]
***Ehtyar has joined #arpnetworks [16:04]
LEMONedup_the_irons: yea. thank you! [16:04]
up_the_ironsnp! [16:05]
***dzup has joined #arpnetworks [16:11]
milkikraigu: bah, primitive ancients
being able to flip bits is a sign of intelligence
[16:12]
kraigumilki: respect for your elders :( [16:21]
***LEMONed has quit IRC (Quit: !stfu) [16:23]
jdoetoddf: well, if/when your script performs the same checks, I'll be happy to run it instead ;)
I use the web checks out of laziness, because I don't care enough to write the same thing in [some cli form]
[16:33]
up_the_ironsup_the_irons whistles a song [16:40]
.............. (idle for 1h6mn)
kraiguup_the_irons is gangnam style :[17:47] <up_the_irons> wut
you were whistling!
[17:46]
up_the_ironsis stuff like this helpful to anyone: http://wiki.arpnetworks.com/wiki/incident-report-09-25-2012-kvr25-unexpected-shutdown-and-power-control-fault
we write these internally
and today i thought, i wonder if making them public would be of any use
[18:01]
kraiguup_the_irons: if it affected my own VPS, sure :D
but generally I trust companies that disclose things like that voluntarily more than companies that go oh hey 99.999999999% uptime!!!!!@@
[18:04]
up_the_ironskraigu: outage reports are sent anyway (via email) but they are just basic summaries. so i'm wondering if the full report is useful at all.
kraigu: yeah, same here
[18:05]
kraiguif you're doing it anyway, internally
why not?
[18:06]
up_the_ironscuz it is a little bit of a PITA stuffing it into the wiki and removing stuff that might pose a security issue [18:07]
kraiguyeah, I hear you [18:08]
***Mexicainvexed has quit IRC (Quit: Leaving) [18:09]
......... (idle for 42mn)
LEMONed has joined #arpnetworks [18:51]
jdoeI don't. FULL DISCLOSURE.
jdoe ducks
[18:53]
kraigukraigu pokes jdoe's eardrums out [18:59]
mercutioup_the_irons: that's way better than most people's incident reports
although what i'm curious about is what actually happened to the box
i assume that'll take a while to determine though
[19:04]
up_the_ironsmercutio: yeah and with our work load it may not even be really worth it to figure out at this time. i've seen backplane failures before so i'm just going to assume it is that for now. the immediate need is to build a new spare now that the current one is in use.
mercutio: the dead box is on my workbench at the moment; i don't see any obvious problem with it (burns, etc...)
[19:06]
kraiguup_the_irons: hit it with a fireaxe, then you'll *know* what the problem is. "gaping hole in case, damaged CPU" [19:15]
up_the_ironskraigu: lol [19:15]
kraigukraigu is no longer allowed to touch servers [19:16]
***dj_goku has joined #arpnetworks
dj_goku has quit IRC (Changing host)
dj_goku has joined #arpnetworks
[19:16]
up_the_ironsup_the_irons keeps kraigu from touching ANYTHING [19:16]
kraigueven myself?
bye bye sex life :(
[19:16]
mercutiokraigu: sounds good [19:23]
up_the_ironslol [19:23]
mercutiohardware is annoying to deal with [19:23]
***LEMONed has quit IRC (Quit: I/O Error)
LEMONed has joined #arpnetworks
[19:25]
jdoe(kraigu solves that by not having any.)
*rimshot*
[19:35]
kraiguwait
are we talking about sexlife or hardware here? :(
I have neither, not since up_the_irons banned me from touching anything, but I just want to be clear in which way you're insulting me so I can fashion my voodoo rites accordingly
[19:37]
..... (idle for 21mn)
mnathaniHi toddf: I tried your nscheck on a centos6 system after installing ksh, and get a few errors like: ./nscheck[18]: local: not found [No such file or directory] [19:59]
***toddf has quit IRC (Ping timeout: 246 seconds)
LEMONed has quit IRC (Quit: I/O Error)
[20:11]
......... (idle for 44mn)
jlgaddis< kraigu> but generally I trust companies that disclose things like that voluntarily <-- +1
up_the_irons: as an IT guy, it helps me to understand what happened and not get pissed. take that fwiw. =)
like the other day, if all i knew was "physical server down" i wouldn't have been nearly as patient. you mentioned what (you thought) was going on and i thought "oh, shit, yeah, that sucks. okay." and went on about my business.
[20:56]
......... (idle for 43mn)
***Webhostbudd has joined #arpnetworks [21:41]
......................... (idle for 2h0mn)
jpalmer has joined #arpnetworks [23:41]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)