***: hive-mind has joined #arpnetworks
jlgaddis has joined #arpnetworks
hazardous has quit IRC (Ping timeout: 265 seconds)
hazardous has joined #arpnetworks
hive-mind has quit IRC (Ping timeout: 244 seconds)
hive-mind has joined #arpnetworks
dj_goku_ has joined #arpnetworks
dj_goku has quit IRC (Read error: Connection reset by peer)
technoid_ has quit IRC (Quit: (null))
sjackso has joined #arpnetworks
technoid_ has joined #arpnetworks mnathani: I just love how I reinstalled my Windows 8 OS on my main desktop, but when I reconnect my tmux session, all my terminals, windows, weechat sessions are intact. Magical stuff mercutio: yeah tmux is handy :)
i kind of wish putty could sync sessions, fonts, etc.
did you use ninite mnathani ? it's really good for windows installs.
basically you just select from a list of programs you want installed like putty etc and it downloads/installs them. it even downloads and installs at once. brycec: All without user interaction mercutio: yeah it's pretty amazing if you're into windows. brycec: Extremely handy for bringing up new Windows installs. mercutio: or just want to install useful programs on someone's computer
i like it how it doesn't include too much stuff. kusuriya: the other thing I love for bringing up windows installs honestly is chocolaty
I install windows, install that, and run a script to pull all of my apps from there ***: RandalSchwartz has joined #arpnetworks RandalSchwartz: gonna try to see if I can VNC into the console... again.
if not, I'm hoping up_the_irons is around. :) mercutio: haven't heard of chocolaty
everything seems to be about chocolate
was it a joke? RandalSchwartz: for the dedi machines, I want "remote control" "redirect console"?
and then "launch console" which still seems like it does nothing. :)
ahh.. right. same problem as before. unsigned java, so I can't run it at all. up_the_irons: RandalSchwartz: i'll be in a better position to watch the console around 4:30; i'm on a bad connection here right now mercutio: randal yeah for dedicated annoying java thingy
did you end up trying ipmi? RandalSchwartz: OK - let me know
ipmi doesn't provide the VNC-like interface I need, and serial console is not yet enabled. acf_: RandalSchwartz: are you trying to do it in the browser? RandalSchwartz: yes acf_: I had the same problem
I think supermicro has some jar file on their ftp
for Linux RandalSchwartz: Oh wait... I had that somewhere. acf_: you can run with java -jar ... and it will give you a UI RandalSchwartz: ok... I have the supermicro logged in
"Launch KVM Console" pops up a black screen, then immediately closes. acf_: I think the VNC broke for me though. it runs some libc-linked binary that wasn't compatible with my libc
^ that
that sucks
if you look at the debug output, that's what's happening
I think I ended up just finding a Windows box to use RandalSchwartz: and the text console requires rebooting and changing a very critical file
such that if I screw it up, I don't get booted. acf_: fun
apparently the SuperMicro remote console view thingy is actually just VNC
but with some funny authentication extension up_the_irons: RandalSchwartz: for me, when i get a black screen that immediately closes, i just click the launch button again and it works
RandalSchwartz: i'll let you know when i'm back at the office RandalSchwartz: nope - I've hit it five times in a row
no good
I wonder if I could trick chicken of the VNC to talk to it mercutio: i wish there was something like ipmi for graphical console.
so hp/dell/supermicro/etc dont' all have different interfaces/problems
although they all seem to have similar annoyances with wanting to use java tbh up_the_irons: RandalSchwartz: i've tried tricking VNC to talk to it, but even though it runs on port 5900, it is some type of Supermicro proprietary VNC, which doesn't work with regular VNC in my experience RandalSchwartz: ugh acf_: probably wouldn't be too difficult to reverse engineer RandalSchwartz: not like VNC is a standard or anything acf_: it's because they don't want to use password authentication mercutio: hp has an emulated text console
you can just ssh in and type a command and it'll show you the screen in text
(as well as having seperate serial port for remote console)
the hp one is kind of laggy and annoying and not wonderful, but you use it so rarely that it doesn't really matter.
that is, it works.
i can't relaly see supermicro suddenly going open, but maybe people should pressure them to be "feature complete" with hp/dell RandalSchwartz: well. the supermicro java has a serial console feature
but again, since I haven't enabled that in freebsd, I don't have it mercutio: so does openipmi
yeah enable it in freebsd, and you can just use ipmi console, using ipmitool.
have you got a windows box you can try from? plett: ipmitool sol works great with supermicro ipmi cards, I use it all the time mercutio: plett: oonce you set it up :) plett: mercutio: On Debian, that's just a matter of telling the grub bootloader to use a serial port as it's console mercutio: plett: it doesn't help if it's not setup though
afaik randal can't get into his box at all atm acf_: RandalSchwarts: use Debian? mercutio: serial console in freebsd is easy too
console="comconsole" plett: Set up how? I don't recall having to set anything up in the ipmi card via the bios before hand mercutio: in /boot/loader.conf acf_: GRUB_CMDLINE_LINUX="console=tty0 console=ttyS0,19200n8"
in /etc/default/grub mercutio: he said he was using freebsd iirc acf_: I see mercutio: that was off hp box but i'm sure it's the same acf_: yea, I've used that before
unless it requires a certain baud rate or something plett: On Debian with systemd (and probably other systemd machines too) you don't have to enable the getty on the serial port, it notices that grub is using serial as the console and does it for you
All hail systemd :) acf_: yesterday my systemd on Debian got into a tight loop and wouldn't do anything mercutio: oh hmm, acf_: http://lists.freedesktop.org/archives/systemd-devel/2015-January/026811.html mercutio: ttyu0"/usr/libexec/getty std.57600"vt100on secure
think you need that in /etc/ttys
it doesn't like the tabs i think dne: and on recent freebsd there's "onifconsole" which I guess is a bit like what plett described except w/o the dbus crap :) plett: dne: I didn't know that. How recent? I haven't seen it in 10.0 dne: 10.1 at least, and I think 9.3 plett: That probably means that I need to upgrade one of my 10.0 test machines to 10.1 to try it dne: yup it's in the release notes for 10.1 & 9.3 RandalSchwartz: I know it's a simple edit to /boot/loader.conf, but if I screw that up, the box doesn't boot at all, I presum.
so I have to have someone who can get to the console to diagnose and fix how it's broken. mercutio: i think you can set it at the bootloader too RandalSchwartz: but the bootloader doesn't see the serial port unless it's in that mercutio: yeah it does RandalSchwartz: and I can't get to the bootloader without vnc dne: just a getty on SOL may be better that nothing? mercutio: the supermicro bios outputs to serial port as well as screen RandalSchwartz: oh, interesting
so if I reboot the machine, but watch the serial port, I should be ok mercutio: if the bios option is set at least.
hmm RandalSchwartz: ok - how would I verify that? :) mercutio: you're booted right now right? RandalSchwartz: yes, running now mercutio: do you know the motherboard model? RandalSchwartz: No mercutio: let's just check the manual
uhh RandalSchwartz: something in dmesg would tell me? mercutio: yeah if you still got that RandalSchwartz: yes mercutio: dmidecode should tell you too RandalSchwartz: command not found: dmidecode mercutio: there's a package
i checked it was on my freebsd box i checked the serial on :)
dmidecode-2.11 A tool for dumping DMI (SMBIOS) contents in human-readable RandalSchwartz: where is it in dmesg?
oh... I'd have to add that to my poudriere to install it mercutio: i don't have a boot dmesg RandalSchwartz: I don't install from fbsd pkg mercutio: it's in ports as sysutils/dmidecode if that's easier? RandalSchwartz: ACPI APIC Table: <SUPERM SMCI--MB> mercutio: yeah acpi not good enough RandalSchwartz: so that won't mirror to console up_the_irons: RandalSchwartz: i have the console open, so if you want to do your thing, i'll watch RandalSchwartz: ok... here we go up_the_irons: roger mercutio: open serial console as it boots RandalSchwartz: woo hoo. I have cache!
seems to be working fine mercutio: you saw bios? RandalSchwartz: no... just typed "zpool add zroot cache ad8" mercutio: oh RandalSchwartz: and "zpool info -v zroot" shows the cache in place up_the_irons: sweet mercutio: you have ssd? RandalSchwartz: yes
120G of ssd mercutio: cool.
don't use 120gb for ssd cache on zfs
it takes up too much ram RandalSchwartz: and 864G of real disk, mirrored mercutio: just a word of warning :) RandalSchwartz: we got fat mem on that box too mercutio: well 120gb is too much for 32gb of ram really RandalSchwartz: too late. already added. :)
actually, I can remove it mercutio: also it isn't persistent RandalSchwartz: but is there a way to just use a portion? mercutio: yeah use a partition RandalSchwartz: why woudln't more ssd be better? mercutio: you probably only have 60gb or less of hot data anyway
you can also add another cache device in addition to the first if you find it too small RandalSchwartz: heh.. given I have only 120GB of data on disk, I bet yes. mercutio: heh
yeah unfortunately zfs's memory consumption could do work some optimisation. up_the_irons: we could add a 256GB SSD :)
even 2x 256GB SSD ;) RandalSchwartz: I wonder if I should try to remove it, just to see if I can
since up_the_irons is watching mercutio: what freebsd version? up_the_irons: RandalSchwartz: i still have the console open RandalSchwartz: 8.4 mercutio: i think removing caches wasn't implemented at the start RandalSchwartz: is there a way to look at cache stats? mercutio: yeah look at arcstats
or zpool iostat -v RandalSchwartz: yeah, watching iostat.
oh... -v
heh ... cache 1.68G used mercutio: you can do zpool iostat -v 1 RandalSchwartz: 118G free :) mercutio: to see it every second RandalSchwartz: yeah - doing that mercutio: cache - - - - - -
sdg1 60.8G 19.2G 6 7 44.8K 88.3K
that's off a real machine
which i learnt about not having too big cache on -: mercutio wonders how you can have a not real machine mercutio: but yeah you may be fine RandalSchwartz: virtual machine mercutio: true up_the_irons: ghost in the machine mercutio: so even with a 80gb cache it hasn't got up to 80gb utilisation yet.
i actualyl experimented with using flash drive as cache too, it actually worked quite well for metadata.
using the sandisk usb3 ones.
normally ssd isn't used for bulk storage.
you can adjust how fast it writes etc.
but by default it basically will only try and capture random data access
also depending on the ssd you're meant to short stroke them less or more
but as a general rule of thumb you should be short stroking them 5 to 30%
more towards 30% for cheap/old/worn/crap ssd's.
and more towards 5% for high end RandalSchwartz: I might be hallucinating, but it feels a bit faster already mercutio: probably hallucinating
it's actually quite hard to notice the difference. most issues come from writes.
given sufficient ram etc.
i suppose i'm a bit of a non believer. it helps a bit if you're tight on resources, but there seems to be more improvement with metadata than real data.
but slog generally helps more
and because it uses memory that would otherwise be used for caching to store lookups it can reduce performance. RandalSchwartz: slog? mercutio: zil? RandalSchwartz: ahh... yeah... I recall that.
should I be using this ssd for that instead? mercutio: as well normally
grr i can't paste atm it seems
slog/zil is for writes RandalSchwartz: so if I set up two partitions, used one for zil, the other for l2arc? mercutio: l2arc/cache is for reads
yeah
but if ssd fails you can lose more data
so some people say you should have two
err if ssd fails at the time of power loss
so slog is like bbwc
but with ssd
it puts synchronous writes there
which means you can really improve performance of synchronous writes.
but it's not used for async writes.
there are tools to measure.
generally speaking i'd say if you only have 120gb of data it's better to use 2x256gb ssd's RandalSchwartz: and the day we did that, we'd need 257gb :) mercutio: enable lz4 compression
lz4 compression is also good
but yeah on e3/i7 type machines i'd generally say go for 32gb of memory before considering l2arc.
but if you're dual using it for other things it can still be good RandalSchwartz: Oooh.. building ports... now using 8.17G of my cache! mercutio: heh
the question is is it data you will use again? RandalSchwartz: probably not
hopefully, I'm not building gcc... again. mercutio: it's pretty hard to know
yeah but this stuff going into cache will be stuff that was in memory before that RandalSchwartz: true mercutio: so it may be helping you, but no more than having 8gb more ram so far :) up_the_irons: RandalSchwartz: do you still need me on the console? RandalSchwartz: No - thank you
but when I enable the serial console... I'll probably want you around in case that hoses.
... ARC: 17G Total, 3044M MFU, 12G MRU, 14M Anon, 615M Header, 1352M Other mercutio: i thought that's what you were going to do while he was around? RandalSchwartz: no - I was adding the cache mercutio: the mfu part is cool. up_the_irons: RandalSchwartz: i can remain on it if you want to enable serial mercutio: ahh RandalSchwartz: and didn't know if that would freeze the machine
No - I don't want to reboot maayan right now up_the_irons: RandalSchwartz: or we can do it later, i'm working at a client's office until like midnight tonight, so i'll be around RandalSchwartz: it'll have to be closer to off hours
we're still mostly west coast prime-time for neil's stuff mercutio: do you have cacti randal?
you can measure load average pretty easily RandalSchwartz: zabbix mercutio: that's one of the best ways to see what performance impact there is
oh that can do that too right? RandalSchwartz: yeah
graphs and alerts mercutio: yeah
i would be curious to know what difference you find RandalSchwartz: build finished
dmidecode now available mercutio: cool RandalSchwartz: what am I looking for? mercutio: Product Name RandalSchwartz: SMBIOS 2.7 present.
Product Name: X9SCL/X9SCM mercutio: cool yeah that's better RandalSchwartz: there's lots of product names
which one? mercutio: they'll be the same
for our purposes at least RandalSchwartz: oh, here's BIOS info mercutio: grr is it tmux or urxvt not letting me paste RandalSchwartz: no product name there
serial services are supported mercutio: weird it doesn't work in putty too
i got the manual in front of me ***: merc2 has joined #arpnetworks merc2: http://www.supermicro.com/manuals/motherboard/C202_C204/MNL-1270.pdf mercutio: it's actually not loading well :(
like 15k/sec
look at 4-12 merc2: COM0/COM1/SOL Console Redirection
Use this feature to enable console redirection for COM0 and COM1 ports. The options
are Enabled and Disabled. The default for all ports are Disabled.
Serial Port for Out-of-Band Management / Windows Emergency
Management Services (EMS)
Use this feature to enable console redirection. The options are Enabled and Disabled.
The default is Disabled. mercutio: so yeah it's not enabled by default, so probably has to be set RandalSchwartz: I would set that using the java app? mercutio: yeah
in bios
unless it was done when the system was provisioned. RandalSchwartz: and where would that be in ipmiview mercutio: does ipmiview let you access bios settings? RandalSchwartz: I don't know -: RandalSchwartz grins RandalSchwartz: actually - that jpmi thingy might have had something taht said bios
oops no... I mean the web-based thing
what is the "SOL" in "Launch SOL" mercutio: i think that's serial console
serial over lan RandalSchwartz: Nothing says "BIOS" in the supermicro web interface up_the_irons: mercutio: yes, you can access bios over ipmiview. it's the actual console. mercutio: up_the_irons: do you enable console redirection? up_the_irons: mercutio: yes mercutio: cool well there's the answer randal
up_the_irons fixes the broken supermicro defaults :) up_the_irons: my job is to make life easier for you guys
so yes
;) mercutio: heh
i'm used to things being broken, cynical i suppsoe up_the_irons: haha mercutio: so yeah just setting freebsd up shoudl be fine, and you shoudl be able to see freebsd boot loeader
err loader mnathani: mercutio: +1 for ninite. Sucks that Adobe doesnt let them bundle flash anymore, they want people to get the malware / antivirus mcafee install bloatware
chocolatey is kind of like a package manager for windows, looks interesting - but ninite meets my needs at present merc2: cool
i hate flash anyway mnathani: chocolatey: There are 2457 packages BryceBot: That's what she said!! mnathani: BryceBot: that's right!
http://azure.microsoft.com/blog/2015/01/08/largest-vm-in-the-cloud/
32 core, upto 448 GiB Ram and 6.5 TB of SSD storage merc2: 32core is the biggest vm?
i imagine there are cloud providers with sun servers.
http://www.ebay.com/itm/NEW-FACTORY-SUN-ORACLE-T5-2-2-x-3-6GHz-16-Core-32-8GBGB-256GB-2-x-300GB-DVD/121255851496?_trksid=p2047675.c100005.m1851&_trkparms=aid%3D222007%26algo%3DSIC.MBE%26ao%3D1%26asc%3D27673%26meid%3Dd7bbfaf283dc4a068f59dfe8cc7a93bf%26pid%3D100005%26prg%3D11378%26rk%3D1%26rkt%3D6%26sd%3D141185644376&rt=nc
that's 32core, with 256 threads
not that i'm going to buy one, but it seems surprising that no-one would be selling servers on sparc.
heh i found a fujitsu server you can buy that takes 64 cpus, (16 cores per cpu i think) 32tb of ram, 128 hard-disk/ssds, 128 pci-e slots.
and up to 56,290 watts of power
but you can also get a 64 core 4u box. up_the_irons: merc2: 56kW of power?! my GAWD
but damn, 64 CPUs... i guess that takes some juice mercutio: yeah 2 racks large too
but that's one of the reason masssive arm servers have been idealised.
with that kind of density it's still a bitch to cool.
i mean it has liquid cooling itself, but the heat has to go somewhere.
i suppose you stick it in the basement, and pipe it into the buildings heaters? up_the_irons: mercutio: i imagine you would hook it into the existing AC chiller pipes ***: novae has quit IRC (Ping timeout: 264 seconds)
novae has joined #arpnetworks
dj_goku_ has quit IRC (Ping timeout: 264 seconds)
dj_goku has joined #arpnetworks
dj_goku has quit IRC (Ping timeout: 240 seconds)
dj_goku has joined #arpnetworks
dj_goku has quit IRC (Changing host)
dj_goku has joined #arpnetworks
eryc has quit IRC (Ping timeout: 255 seconds)
eryc has joined #arpnetworks
eryc has quit IRC (Changing host)
eryc has joined #arpnetworks