***: wallshot1 has joined #arpnetworks
wallshot has quit IRC (Ping timeout: 264 seconds)
sjackso has joined #arpnetworks
brycec is now known as lord_of_lteo
lord_of_lteo is now known as brycec
SpeedBus has quit IRC (Ping timeout: 264 seconds) pjs: guys, any host trouble today? gizmoguy: [@arpnetworks:29] We are investigating an alert we received for host kvr21
perhaps? pjs: okie dokie ***: lteo has joined #arpnetworks
kroberto has joined #arpnetworks pjs: yea.. mine is on kvr21 :-/
well, this one in particular lteo: i just joined the channel. did something just break on kvr21? gizmoguy: https://twitter.com/arpnetworks
yeah something has gone wonky on kvr21
being worked on right now lteo: thanks gizmoguy: [@arpnetworks:30] CPU soft lockup on host kvr21; giving it a power cycle
BryceBot: @twitter @arpnetworks
@twitter @arpnetworks BryceBot: gizmoguy: Posted successfully :) https://twitter.com/BryceBot0101/status/443119129860403200 gizmoguy: oh dear. what have I done
@twitter hello world. /cc @nzgizmoguy BryceBot: gizmoguy: Posted successfully :) https://twitter.com/BryceBot0101/status/443119323335249920 mercutio: haha
bryce does everythiung gizmoguy: BryceBot has 4,642 tweets
wow mercutio: yeh some retweets etc
i'm looking through it now haha brycec: haha mercutio: hazardous/#arpnetworks says: RT @justinbieber you're so hot i want to bake cookies on you
i don't remember that
so i assume twitter support was done ages ago brycec: BryceBot used to announce new messages in its stream, but some people didn't like that ***: kroberto has quit IRC (Remote host closed the connection)
SpeedBus has joined #arpnetworks
lteo has quit IRC (Quit: leaving)
SpeedBus has quit IRC (Ping timeout: 240 seconds)
SpeedBus has joined #arpnetworks up_the_irons: http://i.imgur.com/K13chV7.jpg ***: SpeedBus has quit IRC (Ping timeout: 264 seconds) toddf: awesome ***: SpeedBus has joined #arpnetworks
lteo has joined #arpnetworks lteo: kvr21 down again?
bbl ***: SpeedBus has quit IRC (Ping timeout: 252 seconds)
SpeedBus has joined #arpnetworks up_the_irons: lteo: negative, still up
it does appear your vps is shutdown though
i'll give it a start toddf: probably a stupid question, but .. does anyone have a non java method for hitting the ipmi console? I note it is vnc, but I get told the security type is not handled by my vnc clients ;-( staticsafe: ipmitool?
idk toddf: does it hit the gui console? or only serial? I just installed it thinking it was only serial up_the_irons: toddf: you can hit the serial-over-lan with conserver
toddf: for the actual vga console, i only know of the web gui or ipmiview (both java, unfortunately) toddf: up_the_irons: woah, now thats spiffy, is there a wiki entry somewhere? I suspect it has a couple of lines to setup my end
its vnc'ish wish some free vnc viewer would work
flipping to an amd64 system that has working java up_the_irons: even though the vnc stuff listens on port 5900, it is proprietary vnc and i've never seen a viewer than can use it, you need the java stuff toddf: I'll be sure to give a shout if/when I figure out a non java capable option ;-) mercutio: supermicro ipmi really sucks
ipmi should support serial console toddf: up_the_irons: so .. not to hit up you for details a 2nd time, but is there a wiki article on how to instrument my conserver.cf to talk to the ipmi serial console? up_the_irons: toddf: for conserver, here's a snippet: mercutio: it's a bitch to setup, and i dunno if we're allowed to stick extra ip's on there? up_the_irons: console myserver {
master localhost;
type exec; toddf: oh heh danke! up_the_irons: exec /usr/local/bin/ipmitool -f /root/ipmi-passwd.txt -L USER -I lanplus -C 3 -H <myserver-ipmi-ip> -U sol1 sol activate;
idletimeout 2h;
}
bitte mercutio: oh ipmi is already setup? up_the_irons: on every dedi, yes mercutio: cool. toddf: now the only other thing I can ask for is if you were to put that on the ipmi wiki page for others to use ;-) mercutio: ipmi is a pita to setup :) up_the_irons: toddf: when you get it working, tell me your snippet and i'll make a kb article for it toddf: mercutio: well, up_the_irons has set it up for arp metal so we can be mostly self service just like the kvm side of the house up_the_irons: toddf: mercutio : exactly mercutio: cool
the vnc is really slow
vnc is always slow though toddf: up_the_irons: when I get it working? so the bit you pasted above wont work or ?
mercutio: true, if I can install this over serial I will, but I believe I at least need vga console long enough to tell it to 'set tty com0' ;-) up_the_irons: toddf: that's not an example taken from an arp metal server, but one of my kvm hosts. however, the idea is the same. mercutio: toddf: with the floppy for openbsd it's easy to change :) up_the_irons: toddf: you may have to adjust a few things, dunno mercutio: maybe can provide a floopy install image
with serial or something
i wonder how to make iso's... toddf: its possible to create an iso image with boot.conf pointing at serial just as easily mercutio: actually... it may just work you know
if the bios outputs to serial, the bootloader should be using serial too.
ahh ok i know how to mount a floopy image, but not how to reate the cd image :)
but yeah it's probably not that hard
but yeah if the bios is using serial, i imagine the bootloader will still use bios.. and so it should work. toddf: openbsd's bootloader tends to know serial from vga, and only does serial if boot.conf or 'boot> set tty com0' has instructed it to do so mercutio: that said i've hit issues with grub and serial console before
even if the bios does serial? toddf: bios may be able to force it to serial but then openbsd once the kernel loads switches to vga since it thinks its not serial mercutio: yeh
but you can still type set tty com0
on the serial toddf: bleh, this java bits seems to want to give me an arch specific jar file (read: shared libs precompiled on specific platforms, aka openbsd need not apply)
right, if I can get that far *grin* mercutio: i gave up last time i tried using the ipmi
err java thing
and just used a windows host staticsafe: yeah supermicro ipmi is bleh mercutio: for some reason my java seems to be ok with hp java but not supermicro java toddf: "no iKVM64 in java.library.path"
well, this is a fact I've run into way back 10yrs or more ago
some "java" files actually contain os specific libs and call out to the libs in an os specific fashion, if your os wasn't prebuilt, it won't work mercutio: hp at least have ssh
and then you can do vsp/textcons
actually i imagine a lot of people use supermicro with linux toddf: I once had to install linux to do java console for iDRAC6, but icedtea-web since took care of that requirement mercutio: you'd think there'd be enough demand for them to want to improve it
the supermicro ipmi tool thingy is pretty bad too
they've got something that can do serial console etc in windows
err and linux with java i think toddf: yes there are linux libs
http://sprunge.us/eKUH
see the viewer.jnlp ? it downloads specific bits per arch mercutio: but you can do everythign with ipmitool
you can actually cnofigure ipmitool without using the web etc
if you have root on a server, well normally at least. staticsafe: mercutio: i had to tshoot a friend's supermicro dedi recently (forgot his root password) mercutio: but it's not very user friendly staticsafe: that was fun toddf: everything, including seeing gui or are you saying you can tell the bios to force serial console from ipmitool mercutio: the latter staticsafe: so boot with finnix, chroot in, passwd failed to update password toddf: hints or 'go rtfm' ? staticsafe: turns out he was out of disk space mercutio: well you can setup permissions users etc
i think the bios always outputs to serial?
actually on that note
i wonder if it's first or second serial port toddf: oh if I can config the bios via serial console, the win mercutio: ok i'm going to try this ipmi thjing out
hah it segfaulted
Error: Unable to establish IPMI v2 / RMCP+ session
i wonder if it's meant to be ipmi v2
i thought lanplus was 1.5 toddf: I note up_the_irons example above uses -L USER yet my ipmitool uses -U USER, wonder what -U sol1 is equivalent in my tool mercutio: i think user is USER
rather than your username?
and it's a privilege level thing toddf: oooh -: toddf learns mercutio: taking it out and it does the same
Error: Unable to establish IPMI v2 / RMCP+ session
i tried sensor too
which also didn't work
i love it how it segfaults when it has an issue thoug toddf: mine doesn't segfault ironically
just get the same issues mercutio: oh
curious toddf: ipmitool 1.8.11 fwiw mercutio: i have 1.8.13
ipmitool sensor works locally toddf: oh inside the os inside the machine or ? mercutio: yeh
so there's definitely ipmi
i can't remember how to list users :)
ohhh
user isn't sol1
it's ipmitool user list for listing users btw
and it says it can't set to admin
got it
i took out that -L USER before :)
so yeah s/sol1/your username/
i don't want to reboot to see if bios works toddf: haha the java gui viewer doesn't work but the java serial console viewer does hahahahaa mercutio: ahh ok toddf: let me see if that makes any headway mercutio: if java serial console works ipmitool should work too
i imagine up_the_irons is using sol1 on his hosts toddf: that totally worked heh
java didn't notice when ipmitool took over serial, just stopped refreshing
heh, looks like I could setup a tftp server on one of the other kvm systems on the customer vlan and end up with a tftpboot install, sweet
now that this is working, I have to go SIGFOOD, bah, thanks mercutio ;-) mercutio: haha
my food just finished heating up ***: NiTeMaRe has joined #arpnetworks
lteo has quit IRC (Quit: leaving)
jlgaddis has quit IRC (Ping timeout: 246 seconds)
jlgaddis has joined #arpnetworks