guys, any host trouble today? [@arpnetworks:29] We are investigating an alert we received for host kvr21 perhaps? okie dokie yea.. mine is on kvr21 :-/ well, this one in particular i just joined the channel. did something just break on kvr21? https://twitter.com/arpnetworks yeah something has gone wonky on kvr21 being worked on right now thanks [@arpnetworks:30] CPU soft lockup on host kvr21; giving it a power cycle BryceBot: @twitter @arpnetworks @twitter @arpnetworks gizmoguy: Posted successfully :) https://twitter.com/BryceBot0101/status/443119129860403200 oh dear. what have I done @twitter hello world. /cc @nzgizmoguy gizmoguy: Posted successfully :) https://twitter.com/BryceBot0101/status/443119323335249920 haha bryce does everythiung BryceBot has 4,642 tweets wow yeh some retweets etc i'm looking through it now haha haha hazardous/#arpnetworks says: RT @justinbieber you're so hot i want to bake cookies on you i don't remember that so i assume twitter support was done ages ago BryceBot used to announce new messages in its stream, but some people didn't like that http://i.imgur.com/K13chV7.jpg awesome kvr21 down again? bbl lteo: negative, still up it does appear your vps is shutdown though i'll give it a start probably a stupid question, but .. does anyone have a non java method for hitting the ipmi console? I note it is vnc, but I get told the security type is not handled by my vnc clients ;-( ipmitool? idk does it hit the gui console? or only serial? I just installed it thinking it was only serial toddf: you can hit the serial-over-lan with conserver toddf: for the actual vga console, i only know of the web gui or ipmiview (both java, unfortunately) up_the_irons: woah, now thats spiffy, is there a wiki entry somewhere? I suspect it has a couple of lines to setup my end its vnc'ish wish some free vnc viewer would work flipping to an amd64 system that has working java even though the vnc stuff listens on port 5900, it is proprietary vnc and i've never seen a viewer than can use it, you need the java stuff I'll be sure to give a shout if/when I figure out a non java capable option ;-) supermicro ipmi really sucks ipmi should support serial console up_the_irons: so .. not to hit up you for details a 2nd time, but is there a wiki article on how to instrument my conserver.cf to talk to the ipmi serial console? toddf: for conserver, here's a snippet: it's a bitch to setup, and i dunno if we're allowed to stick extra ip's on there? console myserver { master localhost; type exec; oh heh danke! exec /usr/local/bin/ipmitool -f /root/ipmi-passwd.txt -L USER -I lanplus -C 3 -H -U sol1 sol activate; idletimeout 2h; } bitte oh ipmi is already setup? on every dedi, yes cool. now the only other thing I can ask for is if you were to put that on the ipmi wiki page for others to use ;-) ipmi is a pita to setup :) toddf: when you get it working, tell me your snippet and i'll make a kb article for it mercutio: well, up_the_irons has set it up for arp metal so we can be mostly self service just like the kvm side of the house toddf: mercutio : exactly cool the vnc is really slow vnc is always slow though up_the_irons: when I get it working? so the bit you pasted above wont work or ? mercutio: true, if I can install this over serial I will, but I believe I at least need vga console long enough to tell it to 'set tty com0' ;-) toddf: that's not an example taken from an arp metal server, but one of my kvm hosts. however, the idea is the same. toddf: with the floppy for openbsd it's easy to change :) toddf: you may have to adjust a few things, dunno maybe can provide a floopy install image with serial or something i wonder how to make iso's... its possible to create an iso image with boot.conf pointing at serial just as easily actually... it may just work you know if the bios outputs to serial, the bootloader should be using serial too. ahh ok i know how to mount a floopy image, but not how to reate the cd image :) but yeah it's probably not that hard but yeah if the bios is using serial, i imagine the bootloader will still use bios.. and so it should work. openbsd's bootloader tends to know serial from vga, and only does serial if boot.conf or 'boot> set tty com0' has instructed it to do so that said i've hit issues with grub and serial console before even if the bios does serial? bios may be able to force it to serial but then openbsd once the kernel loads switches to vga since it thinks its not serial yeh but you can still type set tty com0 on the serial bleh, this java bits seems to want to give me an arch specific jar file (read: shared libs precompiled on specific platforms, aka openbsd need not apply) right, if I can get that far *grin* i gave up last time i tried using the ipmi err java thing and just used a windows host yeah supermicro ipmi is bleh for some reason my java seems to be ok with hp java but not supermicro java "no iKVM64 in java.library.path" well, this is a fact I've run into way back 10yrs or more ago some "java" files actually contain os specific libs and call out to the libs in an os specific fashion, if your os wasn't prebuilt, it won't work hp at least have ssh and then you can do vsp/textcons actually i imagine a lot of people use supermicro with linux I once had to install linux to do java console for iDRAC6, but icedtea-web since took care of that requirement you'd think there'd be enough demand for them to want to improve it the supermicro ipmi tool thingy is pretty bad too they've got something that can do serial console etc in windows err and linux with java i think yes there are linux libs http://sprunge.us/eKUH see the viewer.jnlp ? it downloads specific bits per arch but you can do everythign with ipmitool you can actually cnofigure ipmitool without using the web etc if you have root on a server, well normally at least. mercutio: i had to tshoot a friend's supermicro dedi recently (forgot his root password) but it's not very user friendly that was fun everything, including seeing gui or are you saying you can tell the bios to force serial console from ipmitool the latter so boot with finnix, chroot in, passwd failed to update password hints or 'go rtfm' ? turns out he was out of disk space well you can setup permissions users etc i think the bios always outputs to serial? actually on that note i wonder if it's first or second serial port oh if I can config the bios via serial console, the win ok i'm going to try this ipmi thjing out hah it segfaulted Error: Unable to establish IPMI v2 / RMCP+ session i wonder if it's meant to be ipmi v2 i thought lanplus was 1.5 I note up_the_irons example above uses -L USER yet my ipmitool uses -U USER, wonder what -U sol1 is equivalent in my tool i think user is USER rather than your username? and it's a privilege level thing oooh taking it out and it does the same Error: Unable to establish IPMI v2 / RMCP+ session i tried sensor too which also didn't work i love it how it segfaults when it has an issue thoug mine doesn't segfault ironically just get the same issues oh curious ipmitool 1.8.11 fwiw i have 1.8.13 ipmitool sensor works locally oh inside the os inside the machine or ? yeh so there's definitely ipmi i can't remember how to list users :) ohhh user isn't sol1 it's ipmitool user list for listing users btw and it says it can't set to admin got it i took out that -L USER before :) so yeah s/sol1/your username/ i don't want to reboot to see if bios works haha the java gui viewer doesn't work but the java serial console viewer does hahahahaa ahh ok let me see if that makes any headway if java serial console works ipmitool should work too i imagine up_the_irons is using sol1 on his hosts that totally worked heh java didn't notice when ipmitool took over serial, just stopped refreshing heh, looks like I could setup a tftp server on one of the other kvm systems on the customer vlan and end up with a tftpboot install, sweet now that this is working, I have to go SIGFOOD, bah, thanks mercutio ;-) haha my food just finished heating up