guys, any host trouble today?
[@arpnetworks:29] We are investigating an alert we received for host kvr21
perhaps?
okie dokie
yea.. mine is on kvr21 :-/
well, this one in particular
i just joined the channel. did something just break on kvr21?
https://twitter.com/arpnetworks
yeah something has gone wonky on kvr21
being worked on right now
thanks
[@arpnetworks:30] CPU soft lockup on host kvr21; giving it a power cycle
BryceBot: @twitter @arpnetworks
@twitter @arpnetworks
gizmoguy: Posted successfully :) https://twitter.com/BryceBot0101/status/443119129860403200
oh dear. what have I done
@twitter hello world. /cc @nzgizmoguy
gizmoguy: Posted successfully :) https://twitter.com/BryceBot0101/status/443119323335249920
haha
bryce does everythiung
BryceBot has 4,642 tweets
wow
yeh some retweets etc
i'm looking through it now haha
haha
hazardous/#arpnetworks says: RT @justinbieber you're so hot i want to bake cookies on you
i don't remember that
so i assume twitter support was done ages ago
BryceBot used to announce new messages in its stream, but some people didn't like that
http://i.imgur.com/K13chV7.jpg
awesome
kvr21 down again?
bbl
lteo: negative, still up
it does appear your vps is shutdown though
i'll give it a start
probably a stupid question, but .. does anyone have a non java method for hitting the ipmi console? I note it is vnc, but I get told the security type is not handled by my vnc clients ;-(
ipmitool?
idk
does it hit the gui console? or only serial? I just installed it thinking it was only serial
toddf: you can hit the serial-over-lan with conserver
toddf: for the actual vga console, i only know of the web gui or ipmiview (both java, unfortunately)
up_the_irons: woah, now thats spiffy, is there a wiki entry somewhere? I suspect it has a couple of lines to setup my end
its vnc'ish wish some free vnc viewer would work
flipping to an amd64 system that has working java
even though the vnc stuff listens on port 5900, it is proprietary vnc and i've never seen a viewer than can use it, you need the java stuff
I'll be sure to give a shout if/when I figure out a non java capable option ;-)
supermicro ipmi really sucks
ipmi should support serial console
up_the_irons: so .. not to hit up you for details a 2nd time, but is there a wiki article on how to instrument my conserver.cf to talk to the ipmi serial console?
toddf: for conserver, here's a snippet:
it's a bitch to setup, and i dunno if we're allowed to stick extra ip's on there?
console myserver {
        master localhost;
        type exec;
oh heh danke!
        exec /usr/local/bin/ipmitool -f /root/ipmi-passwd.txt -L USER -I lanplus -C 3 -H <myserver-ipmi-ip> -U sol1 sol activate;
        idletimeout 2h;
}
bitte
oh ipmi is already setup?
on every dedi, yes
cool.
now the only other thing I can ask for is if you were to put that on the ipmi wiki page for others to use ;-)
ipmi is a pita to setup :)
toddf: when you get it working, tell me your snippet and i'll make a kb article for it
mercutio: well, up_the_irons has set it up for arp metal so we can be mostly self service just like the kvm side of the house
toddf: mercutio : exactly
cool
the vnc is really slow
vnc is always slow though
up_the_irons: when I get it working? so the bit you pasted above wont work or ?
mercutio: true, if I can install this over serial I will, but I believe I at least need vga console long enough to tell it to 'set tty com0' ;-)
toddf: that's not an example taken from an arp metal server, but one of my kvm hosts.  however, the idea is the same.
toddf: with the floppy for openbsd it's easy to change :)
toddf: you may have to adjust a few things, dunno
maybe can provide a floopy install image
with serial or something
i wonder how to make iso's...
its possible to create an iso image with boot.conf pointing at serial just as easily
actually... it may just work you know
if the bios outputs to serial, the bootloader should be using serial too.
ahh ok i know how to mount a floopy image, but not how to reate the cd image :)
but yeah it's probably not that hard
but yeah if the bios is using serial, i imagine the bootloader will still use bios.. and so it should work.
openbsd's bootloader tends to know serial from vga, and only does serial if boot.conf or 'boot> set tty com0' has instructed it to do so
that said i've hit issues with grub and serial console before
even if the bios does serial?
bios may be able to force it to serial but then openbsd once the kernel loads switches to vga since it thinks its not serial
yeh
but you can still type set tty com0
on the serial
bleh, this java bits seems to want to give me an arch specific jar file (read: shared libs precompiled on specific platforms, aka openbsd need not apply)
right, if I can get that far *grin*
i gave up last time i tried using the ipmi
err java thing
and just used a windows host
yeah supermicro ipmi is bleh
for some reason my java seems to be ok with hp java but not supermicro java
"no iKVM64 in java.library.path"
well, this is a fact I've run into way back 10yrs or more ago
some "java" files actually contain os specific libs and call out to the libs in an os specific fashion, if your os wasn't prebuilt, it won't work
hp at least have ssh
and then you can do vsp/textcons
actually i imagine a lot of people use supermicro with linux
I once had to install linux to do java console for iDRAC6, but icedtea-web since took care of that requirement
you'd think there'd be enough demand for them to want to improve it
the supermicro ipmi tool thingy is pretty bad too
they've got something that can do serial console etc in windows
err and linux with java i think
yes there are linux libs
http://sprunge.us/eKUH
see the viewer.jnlp ? it downloads specific bits per arch
but you can do everythign with ipmitool
you can actually cnofigure ipmitool without using the web etc
if you have root on a server, well normally at least.
mercutio: i had to tshoot a friend's supermicro dedi recently (forgot his root password)
but it's not very user friendly
that was fun
everything, including seeing gui or are you saying you can tell the bios to force serial console from ipmitool
the latter
so boot with finnix, chroot in, passwd failed to update password
hints or 'go rtfm' ?
turns out he was out of disk space
well you can setup permissions users etc
i think the bios always outputs to serial?
actually on that note
i wonder if it's first or second serial port
oh if I can config the bios via serial console, the win
ok i'm going to try this ipmi thjing out
hah it segfaulted
Error: Unable to establish IPMI v2 / RMCP+ session
i wonder if it's meant to be ipmi v2
i thought lanplus was 1.5
I note up_the_irons example above uses -L USER yet my ipmitool uses -U USER, wonder what -U sol1 is equivalent in my tool
i think user is USER
rather than your username?
and it's a privilege level thing
oooh
taking it out and it does the same
Error: Unable to establish IPMI v2 / RMCP+ session
i tried sensor too
which also didn't work
i love it how it segfaults when it has an issue thoug
mine doesn't segfault ironically
just get the same issues
oh
curious
ipmitool 1.8.11 fwiw
i have 1.8.13
ipmitool sensor works locally
oh inside the os inside the machine or ?
yeh
so there's definitely ipmi
i can't remember how to list users :)
ohhh
user isn't sol1
it's ipmitool user list for listing users btw
and it says it can't set to admin
got it
i took out that -L USER before :)
so yeah s/sol1/your username/
i don't want to reboot to see if bios works
haha the java gui viewer doesn't work but the java serial console viewer does hahahahaa
ahh ok
let me see if that makes any headway
if java serial console works ipmitool should work too
i imagine up_the_irons is using sol1 on his hosts
that totally worked heh
java didn't notice when ipmitool took over serial, just stopped refreshing
heh, looks like I could setup a tftp server on one of the other kvm systems on the customer vlan and end up with a tftpboot install, sweet
now that this is working, I have to go SIGFOOD, bah, thanks mercutio ;-)
haha
my food just finished heating up