***: Lucifer333 has quit IRC (Quit: Leaving) dne: at least on *bsd the "gif" tunnel interface supports both brycec[m]: nathani: yes, a couple in fact. https://en.m.wikipedia.org/wiki/4in6 BryceBot: Error in Wikipedia's response: mhoran: http://www.internetsociety.org/deploy360/resources/case-study-t-mobile-us-goes-ipv6-only-using-464xlat/ -- T-Mobile (and now other carriers in the US) use 464XLAT on IPv6 only phones. ***: Lucifer333 has joined #arpnetworks
Lucifer333 has quit IRC (Client Quit)
Lucifer333 has joined #arpnetworks
acf_ has joined #arpnetworks acf_: the supermicro ipmi kvm is terrible
it's a java application that uses JNI to run native code
except the native code crashes on systems with too new of a libc
I've been trying various configurations of Ubuntu for the last hour trying to get it working.. mercutio: that seems odd, i use archlinux and can access supermicro ipmi
you could try using IPMIView as well plett: IPMIView is the right answer, if you need GUI keyboard+mouse or mounting of remote ISOs. If all you need is a serial console to get to the BIOS menus or drive your PXE booting installer, ipmitool is handy acf_: yeah, I've been trying to use ipmiview mercutio: ipmitool is great if that'sall you need acf_: ipmiview itself starts, but "iKVM" (the kvm part) crashes mercutio: OpenJDK Runtime Environment (IcedTea 2.6.7) (Arch Linux build 7.u111_2.6.7-1-x86_64)
i'm using that java acf_: I think the java part starts fine
but it tries to load iKVM64.so
and the native code seems to explode on new systems mercutio: it seems stupid to have java with native code acf_: yeah. I think the native code is tightvnc or something mercutio: yeah the java is ick. do you think you can get away with serial console? acf_: I don't really want to chance it :/ mercutio: you can do bios, linux etc
the only real issue can be boot loaders that want to do fancy graphical screens acf_: will most live linux disks give me a console over serial automatically? mercutio: you can force linux to disable that stuff
some will
if they keep using the bios, and the bios has serial console enabled
sometimes you have to press escape or such
yeah it isn't as clean as i'd like it to be acf_: hmm.. maybe I'll give that a shot then mercutio: ipmitool -I lanplus -H <ip> -U <username> -P <password> sol activate
should do it acf_: oh cool
that's not even some supermicro software mercutio: yeh it's a standard
there's also power sub command
and sensor ***: dj_goku has quit IRC (Ping timeout: 252 seconds) dne: acf_: I've had some success with this noVNC branch/fork and SM's iKVM: https://github.com/kelleyk/noVNC/tree/bmc-support mercutio: oh, interesting dne: discussions: https://github.com/novnc/noVNC/pull/408 and https://github.com/novnc/noVNC/pull/614 acf_: woah
that looks awesome
I looked for a bit, but couldn't find anything like that dne: it certainly beats the java junk (if you can get it to work with your board)
support matrix: https://docs.google.com/spreadsheets/d/1wVrwOpebTn43ncEBY9dfn1SMVM205NEMwy1W8q_kR3s/edit?usp=sharing
(might not be up-to-date) acf_: I'm pretty sure it uses iKVM / VNC at least mercutio: ATEN only not AMI seems to be it
supermicro are so inconsistent mkb: "the only real issue can be boot loaders that want to do fancy graphical screens" dne: SM's recent firmware has native html5 support too mkb: I do not understand why supposed server oses do fancy graphics mercutio: dmidecode | grep -i product
if you want to check model
mkb: openbsd doesn't
openbsd works perfectly with serial alone mkb: yes openbsd is the best operating system
unfortunately we don't use it at work :( ***: dj_goku has joined #arpnetworks
dj_goku has quit IRC (Changing host)
dj_goku has joined #arpnetworks
dj_goku has quit IRC (Ping timeout: 240 seconds) JC_Denton: updating openbsd is a PITA, imo
especially en masse acf_: dne: do you just launch with ./utils/launch.sh --vnc [host]:5900 ? dne: acf_: yes, I believe so (it's been a while)
and enter USERNAME:PASSWORD as password
(maybe they've improved that now?) acf_: hmm
I'm getting "Unsupported server"
:/ dne: oh :( mercutio: do you know what motherboard it is? acf_: it's an ARP box mercutio: it mostly looks to be the AMI unsupportable, although the ATEN sometimes have issues
does it have OS on it? acf_: I imagine I can find out somehow through ipmi or the web interface?
yea
oh right.. mercutio: dmidecode | grep -i product dne: dmidecode -s baseboard-product-name mercutio: heh dne is more specific dne: (gleaned from the source) acf_: X9SCD mercutio: that works for me too
that's not on the list of working or not working acf_: > https://docs.google.com/spreadsheets/d/1wVrwOpebTn43ncEBY9dfn1SMVM205NEMwy1W8q_kR3s/edit#gid=0
there are some "X9SC..." in there mercutio: but X9SRD has some issues
true
it should be ATEN at least
i suspect it's fixable dne: acf_: sorry for getting your hopes up acf_: I'm probably just not using this novnc thing right dne: hm I can't find the string "unsupported server" in the source
(or I don't know how to search properly on github)
aah "Sorry, forked repositories are not currently searchable"
yes it does exist in the source acf_: oops
forgot to check out the "bmc-support" branch mercutio: sweet
i'm just trying it too
where do you set username? acf_: I think you type "username:password" into the password field
mine is stuck on "Connecting..." now mercutio: well it says connecting
but i can't see anything happening
unsupported server
but i think it's just having trouble talking to it acf_: "Failed to connect to server" here
I can telnet to [ip]:5900 mercutio: maybe you have to initiate remote connection first
oh so can i acf_: > RFB 003.008
so the TCP connection does go through mercutio: there is nothign useful under ast2100 settings
video quality and subsampling mode
but does suggest i have the right branch
maybe password is done diff acf_: there is a little popup at the top of the page for a second when you click "Connect"
that says something about "user:password"
so that's where I got that rom mercutio: you are right
i missed that bit hah acf_: oh, here are some instructions https://basraayman.com/2016/12/03/using-a-novnc-branch-to-connect-to-your-supermicro-ikvm/ mercutio: i saw the left bit
weird, when i click connect it seems to only talk on port 80 not 5900
and that maybe having the other web interafce open acf_: what does? mercutio: i'm tcpdumping on tun09
tun0 acf_: I see traffic to 5900 on tun0 mercutio: when i enter my password it's like no communication seems to happen
after password?
i see it before password acf_: ohhh mercutio: it just says "Connecting..." normally
except it failed before
haha "HTTP: GET /cgi/ipmi.cgi?SENSOR_INFO_FOR_SYS_HEALTH.XML"
tcpdump is auto checking content it seems acf_: oh well
my computer crashed while I was trying to install Ubuntu 14.04 in a VM..
so I guess I should go start that again
typically should I file a ticket if I need an iso image attached that isn't available in the library? mercutio: yeah
if you want it added to library acf_: I mean, I just need to use it for maintainance
but I think it has to be in the library for that mercutio: yeah
you can attach your own iso
but to get it added to list yeah acf_: the supermicro http interface indicates that the iso is loaded from a Windows share
I guess I could run a Windows share locally and try to use the iso over the VPN
but that sounds like a major PITA ***: dj_goku has joined #arpnetworks mercutio: you can't
it's a restricted network
no internet acf_: yeah, but I'm connected to it over VPN, yeah?
to access the interface? mercutio: just send an email with link to ISO you want added acf_: so I could use a share on my VPN IP? mercutio: oh that may work
but the last time i tried doing something like that it was extremely slow acf_: yeah, I imagine so.. mercutio: it may be ok if you have say 20msec ping acf_: well.. I'll try to get this stupid supermicro software working first and then worry about all that mercutio: but with 60 msec ping it'd probably be past the point of irritation a lot :) acf_: it's a live linux cdf
so I think it will load the whole image into RAM? mercutio: i use arch linux as live cd acf_: I basically just need access to the lvm2 tools mercutio: there's otehr live ones in there i think though acf_: and preferrably cfdisk
hmm.. ok. maybe I'll try one mercutio: i use gdisk, arch linux would have lvm2, at lesat
and it has zsh :) acf_: I did a dry run of this operation in a VM earlier with the Debian live CD
so I was going to try to just use the same one mercutio: hmm i haven't checked out debian in a while
ubuntu's installer is brain dead acf_: I run Debian testing on lots of stuff
yeah Ubuntu has some issues mercutio: i did before shifting to ubuntu
now i do arch for personal stuff ubuntu for other stuff
but installing ubuntu with arch is nicer than usign their installer imo gizmoguy: mercutio: any ideas on how to define multiple smokeping probes with different arguments? mercutio: create more smokeping probes? gizmoguy: but the name of the probe is the module it loads right? mercutio: i don'tk now if you can change arguments per target
nope
the binary =
isn't it?
oh hmm
i dunno now :) gizmoguy: nah the name tells it which module (e.g. Smokeping::probes::FPing) to load
it's really annoying me
I'll try define it per host mercutio: Yeah I think you're right
hangon i think you can overload
urlformat = http://%host%/
i've got lines like that
per host i'm tracking gizmoguy: can you do an if statement though mercutio: i doubt it gizmoguy: basically I have an expensive server to query with ICMP mercutio: but i use that for filename gizmoguy: and I want to do it 5 times instead of 20 mercutio: urlformat = http://%host%/ at = http://%host%/200k
of what to curlk
you should be able to change it
you may have to delete the old rrd though
or change it gizmoguy: yeah but I want everything else to be queried 20 times mercutio: try just setting pings = 5
under the ++ gizmoguy: on the Target? mercutio: and host etc
yeh
the web interface will show how many it is
but you may have to remove the old rrd gizmoguy: ERROR: /etc/smokeping/config.d/Targets, line 43: unknown variable 'pings'
:( mercutio: oh gizmoguy: maybe this isn't actually possible... mercutio: it should be gizmoguy: Oh!
A probe can have subsections
so:
+ FPing
++ FPingGentle
pings = 5 mercutio: yeah
i did say ++
did that help?
i didn't even realise you didn't know you could do that gizmoguy: I didn't know a Probe could have a subsection mercutio: mine have all been using that forever gizmoguy: I know Targets can mercutio: i dunno why you can't just put pings = 5 in the target gizmoguy: it doesn't recognise it mercutio: braindead gizmoguy: Which is odd, because that's how the DNS probe and Curl probes work mercutio: yeah
it's only curl i've changed
by expensive do you mean it's on 3g or such? gizmoguy: Nah. There's a piece of slow software that handles ICMP mercutio: ahh
i want to know why this novnc doesn't work gizmoguy: mmm? mercutio: the novnc that works to supermicro servers apparently gizmoguy: can you update the IPMI on the supermicro to a version that does HTML? mercutio: but after putting in a password (any passwrod) it doesn't seem to communicate further acf_: I wonder if the branch is just broken right now gizmoguy: Or is that what you've done mercutio: and just stays "connecting..."
acf: yaeh that's what i'm thinking acf_: I tried reverting to a couple of commits ago mercutio: gizmoguy: not on the old gear acf_: but the history is probably complicated mercutio: gizmoguy: you can use vnc to connect direclty using this git version of novnc in a separate branch gizmoguy: haha
sounds lovely
makes me appreciate my Dell machines even more mercutio: it's nicer than java
it works with dell too
idrac7 and idrac8 gizmoguy: On idrac8 you get VNC over WebSockets mercutio: well that's what novnc is basically gizmoguy: and the DRAC web interface comes with an HTML5 vnc viewer bundled acf_: that's basically what this is gizmoguy: it possibly is novnc
i haven't picked it apart
but it comes stock which is nice acf_: gave up on the ubuntu installer.. trying debian jessie now mercutio: supermicro are doing html on recent stuff too with recent firmware gizmoguy: yeah some of my supermicros do HTML5
It's not as pretty as the dell stuff
but works acf_: oh nice. the Arch install iso has all of the tools I need
mercutio: do you know if it does serial console automatically? mercutio: nah it doesn't
you need to tell it console=ttyS0,115200
you can do another console=tty0 too acf_: hmm mercutio: also if you want to ssh into it
which you probably do acf_: so I'll get the bootloader over the serial console? mercutio: set your ip, passwd, then systemctl start sshd
i have actually been wondering if it's possible to fix the arch linux cd to automatically go to serial
i think with more recent archlinux it was better, i think i'm going to have to test it again
hangon
it's hp rather than supermicro, but i'll boot my home server and test acf_: testing in a VM now mercutio: hp are cool in that you can ssh into them and tell them what cd to boot
oh that's the other way of going duh acf_: it at least shows the bootloader over serial mercutio: <tab><space>console=ttyS0,115200<enter>
should work even if you can't get out of the gui crap
ie typing that blind in serial console acf_: yeah, it seems to work
okay.. well I think I'll try this then mercutio: cool acf_: thanks for all the help mercutio: all good
i know how annoying java can be :)
java works for me but it still does annoying things, liek come up on my screen that's turned off ***: acf__ has joined #arpnetworks
acf_ has quit IRC (Quit: leaving)
Lucifer333 has quit IRC (Quit: Leaving) acf__: having trouble getting it to boot from cdrom..
dammit
well.. serial console worked in the VM
> ISOLINUX 6.03 6.03* ETCD Copyright (C) 1994-2014 H. Peter Anvin et al
but the actual menu is only displayed on the monitor
(I can see it in the "remote console preview" image over http) mercutio: mm type what i said above
@mercutio ? <tab><space>console=ttyS0,115200<enter>
oh it may be two enters acf__: yeah. I tried that mercutio: that's at the menu
it takes a while
because the cd is slow on virtual media
even on lan acf__: I'm refreshing the preview image
it doesn't show that it's doing anything mercutio: does it show in menu?
it usually clears the screen acf__: it shows the menu mercutio: has some grey text saying some loading thing
oh
maybe it needs another enter? acf__: hmm
if I power cycle, and press only enter a bunch of times
should it at least try to boot something? mercutio: yeah if you press enter from arch it'll boot 64 bit acf__: this is strange because in the VM, it displayed the menu over serial mercutio: was it the same archlinux version?
i think it improved acf__: yeah. it was acutally a passthrough of the virtual CD mercutio: oh
i wonder if there's a way to force that menu to behave
without remaking the iso acf__: well my jessie vm just finished installing JC_Denton: hmm
a friend is looking for a Windows-friendly VPS host. mercutio: i wonder if serial port isn't ttyS0 acf__: I checked that it is
stupid iKVM won't work under jessie either.. mercutio: did it used to work?
JC_Denton: and no-one knows :) acf__: I know it worked under some Debian at some point mercutio: i think lots of people using windows tend to use vmware acf__: with some hacking mercutio: but kvm does work with windows JC_Denton: yeah mercutio: there are some hoops JC_Denton: he's in a pickle because he wants to do Office (not 365 or the web versions) and he needs the Windows-specific stuff
he only has a Chromebook though mercutio: hmm
and not enough space to just have a tiny windows box i assume acf__: trying to use office on a vps sounds painful mercutio: what about kvm under linux on the chromebook hah
linux worked quite well on my chromebook
oh maybe not technically inclined acf__: how much ram does the chromebook have? mercutio: i'm guessing 2gb acf__: that's not the kind of platform I'd typically run VMs on mercutio: so in the "not really pretty, but probably ok for office" category acf__: tried to run Windows 10 under kvm the other day
that went terribly mercutio: hmm my chromebook is 2gb, and is old and discotinued
discontinued even
acf: how much ram did you give it? acf__: I think 3GB
it was enough I think mercutio: should be enough acf__: task manager didn't seem unhappy about it mercutio: did you install the proper storage drivers acf__: I also used virtio for all the devices mercutio: i wish starcraft would work on linux acf__: so yeah, loaded the virtio drivers during installation
okay new plan.. start a Windows VM on AWS
and install the shitty supermicro software on that mercutio: i ran windows and linux on the same computer with hardware passthrough of video card for a while
one monitor with onboard video, one with video card
you really shouldn't need windows acf JC_Denton: 4 gb on the chromebook
crouton is not really feasible mercutio: 4gb wow
4gb should be heaps to give 2gb to windows?
when it's running acf__: yeah I know.. but I've tried as much linux as I can
and none of it has worked
I would hope that it would at least work out of the box on Windows
what the hell
it crashes on Windows too
all I need to know is what platform this software runs on
this is completely ridiculous
alright.. well I installed Java on my AWS Windows VM
and added the IPMI URL to the site exception list so that it would run unsigned applets
the KVM viewer works through the web browser now mercutio: maybe that's what you need on linux too acf__: yeah. I guess I could try using the applet in Linux
it seems like kvm through ipmiview doesn't work at all mercutio: it normally should
hmm acf__: I'm using this: ftp://ftp.supermicro.com/utility/ipmiview mercutio: it's not working for me hah
it has in the past
it says Cannot run program "./jre/bin/java" error=13, Permission denied acf__: oh. that's a different one
I'll probably keep the disk for this Amazon VM around and just use it whenever I need to access the console
the whole thing is a piece of crap anyway mercutio: wtf
it looks like fs corruption acf__: fun.. mercutio: oh it's mixing executable access
and behaves strangely
everything was coming up ???????? etc
ipmiview includes it's own java it seems acf__: yeah mercutio: it's segfaulting though acf__: ipmiview itself?
or the kvm thing? mercutio: kvm inside ipmiview acf__: yeah
that's what I was getting mercutio: going to try using normal java on it acf__: if you look at the log, it says it's segfaulting inside of native code
ie, JNI mercutio: how do you run iKVM.jar?
i have he parmas acf__: java -jar iKVM.jar
maybe? mercutio: oh
i was missing the -jar acf__: there is some "iKVM" file in there too
not sure if it's just a script to run that command or not
I didn't look mercutio: core dump acf__: yea mercutio: # C [libiKVM64.so+0x19194] RFBScreen::ScreenDecode()+0x104
is that what you had? acf__: yeah
libiKVM64.so mercutio: exactly? acf__: that's the native code
pretty close
I've nuked all of those VMs now
but it was crashing in that function mercutio: ahh
wow acf__: lemme check the Windows log mercutio: just going to check it still works from browser :) acf__: the Windows log isn't very specific
I guess it doesn't have debugging symbols in the dll
it just shows that it's crashing somewhere in iKVM32.dll mercutio: hmm i got in acf__: yeah
the browser version works mercutio: yeah acf__: I didn't expect that
I imagine it's pretty much the same thing mercutio: i have a jnlp acf__: but I definitely don't want Java installed in the normal browser that I use mercutio: you can do it using javaws acf__: to just launch the jnlp directly?
in fact, I don't really want this sketchy supermicro stuff anywhere on my computer
but maybe in a Linux VM :P mercutio: heh
it does something weird to the password
it's not rot13
but it looks to be about as bad
maybe base64? acf__: as long as you can replay it mercutio: but yeah if you just get the jnlp once
you should be able to execute it later i suspect acf__: yeah
I recall trying that last time I was messing with this
I can't recall if that's what ended up working mercutio: it's kind of messy ***: Lucifer333 has joined #arpnetworks
Lucifer333 has quit IRC (Quit: Leaving)
Nahual has joined #arpnetworks brycec[m]: twss BryceBot: Okay! twss! 'it's kind of messy' ***: Nahual has quit IRC (Quit: Leaving.) up_the_irons: mercutio: mike-burns : it's a child process that has ended but not reaped by the parent
acf__: FYI, I use mercutio's ipmitool "sol activate" snippet all the time. I can get into BIOS, etc... usually without trouble. Boot loaders that don't output to serial, well, that can still be an issue, unfortunately. mercutio: the "not outputingto serial" boot loader issue is way worse on linux than it should be up_the_irons: mercutio: acf__ : indeed, we had a customer that mounted an ISO from their local machine at home to an ARP Metal box, over the VPN. I thought he was crazy but he got the whole thing installed. :) nathani: up_the_irons: how come this customer didnt juet provide you with a wget URL to add the ISO to the SMB share?
s/juet/just BryceBot: <nathani> up_the_irons: how come this customer didnt just provide you with a wget URL to add the ISO to the SMB share? up_the_irons: gizmoguy: acf__ mercutio : that's nice that idrac8 is basically doing noVNC; i didn't know that
acf__: the Arch install ISO is what we use for all our new systems; it has everything you need. From there, debootstrap turns the box into Ubuntu for us. and it works great over serial doing what mercutio said
acf__: you were able to type blind from serial? (like, it works with input but not output?) acf__: yeah, this Arch install ISO is pretty great
when I was doing this with the Debian live CD, I had to actually install the packages for lvm2 into the live cd first mercutio: it also has things like smartmontools acf__: I never got it to respond to input over the serial console. it might be me doing something stupid though of course
I'll try again after this operation is complete when Ireboot mercutio: maybe see if you can get into bios first
just to make sure keyboard is working acf__: yeah. I got into BIOS over the serial console to change the boot order
so I know that works mercutio: ahh acf__: (apparently it doesn't honor the ipmi boot order setting?) mercutio: i didn't know ipmi has boot order acf__: maybe that's why it wasn't working :P
there was some setting in ipmitool that claimed to get it to boot from cdrom mercutio: when mounting new cd sometimes you have to full reset
rather than reboot acf__: > bootdev <device> [<clear-cmos=yes|no>] [<options=help,...>]
> Request the system to boot from an alternate boot device on next reboot
hmm mercutio: hmm that sounds good
hp has something like that, which does work acf__: I was fully powering off each time if that's what you mean mercutio: but you still do a reset
hmm, amybe reset is better than power off
dunno acf__: yeah idk
but changing it in the bios worked
so that was fine mercutio: i change cd with hp with ssh normally now, rather than load up web ui acf__: okay.. so I wait for isolinux to load
then I blindly type "<tab><space>console=ttyS0,115200<enter>" mercutio: type it at the menu yeh
oh and an extra enter
cos i forgot to select the item after changing it
i think you need it twice, acf__: well, I don't get a menu
the only output I get is a single line
> ISOLINUX 6.03 6.03* ETCD Copyright (C) 1994-2014 H. Peter Anvin et al
of course that works if I do it on the graphical console, but not on the serial console mercutio: oh so it's not acceping serial input either
i think what's happening is that syslinux is trying to use the serial port at the same time as ipmi acf__: hmm?
ipmi tries to use the serial port? mercutio: well the menu came up fine on serial port with kvm
yeah the bios uses ipmi acf__: I thought what happened was the serial port was just a normal serial port mercutio: thats' why you can see the bios acf__: and the BIOS uses it, until it transfers control away to something else mercutio: yeah i think the transfering control is being screwy i mean acf__: oh hmm
yeah that could be it
I wonder if there are BIOS options I can tweak that would fix it mercutio: you can probably change the assigned serial port
and syslinux is probably using ttyS0
or 0 serial port
or com1 in legacy terms up_the_irons: nathani: I'm not sure... guess he wanted full control ;) acf__: I mean, if you just can't wait for a support ticket :P mercutio: i've used remote media over dsl actually
it depends what you're booting, some stuff is a lot easier than other nathani: up_the_irons: you probably noticed the spike in traffic over your vpn interface if it was being graphed up_the_irons: i didn't look mercutio: nathani is remote booting iso's? :) nathani: I would probably try it to see if I could get it to work
:-) brycec: I recall that I've tried in the past. I don't remember if I was successful, however. :P
But I have definitely run the iKVM viewer under a modern Arch Linux install
My only hiccup has ever been that icedtea/java use Firefox's proxy settings which aren't my own (I usually use Firefox to switch between socks/https proxies for tunneling). Besides that, `javaws $jnlp_file` and off it goes. mercutio: heh i used to use firefox for alternative proxy as well hah