I just love how I reinstalled my Windows 8 OS on my main desktop, but when I reconnect my tmux session, all my terminals, windows, weechat sessions are intact. Magical stuff yeah tmux is handy :) i kind of wish putty could sync sessions, fonts, etc. did you use ninite mnathani ? it's really good for windows installs. basically you just select from a list of programs you want installed like putty etc and it downloads/installs them. it even downloads and installs at once. All without user interaction yeah it's pretty amazing if you're into windows. Extremely handy for bringing up new Windows installs. or just want to install useful programs on someone's computer i like it how it doesn't include too much stuff. the other thing I love for bringing up windows installs honestly is chocolaty I install windows, install that, and run a script to pull all of my apps from there gonna try to see if I can VNC into the console... again. if not, I'm hoping up_the_irons is around. :) haven't heard of chocolaty everything seems to be about chocolate was it a joke? for the dedi machines, I want "remote control" "redirect console"? and then "launch console" which still seems like it does nothing. :) ahh.. right. same problem as before. unsigned java, so I can't run it at all. RandalSchwartz: i'll be in a better position to watch the console around 4:30; i'm on a bad connection here right now randal yeah for dedicated annoying java thingy did you end up trying ipmi? OK - let me know ipmi doesn't provide the VNC-like interface I need, and serial console is not yet enabled. RandalSchwartz: are you trying to do it in the browser? yes I had the same problem I think supermicro has some jar file on their ftp for Linux Oh wait... I had that somewhere. you can run with java -jar ... and it will give you a UI ok... I have the supermicro logged in "Launch KVM Console" pops up a black screen, then immediately closes. I think the VNC broke for me though. it runs some libc-linked binary that wasn't compatible with my libc ^ that that sucks if you look at the debug output, that's what's happening I think I ended up just finding a Windows box to use and the text console requires rebooting and changing a very critical file such that if I screw it up, I don't get booted. fun apparently the SuperMicro remote console view thingy is actually just VNC but with some funny authentication extension RandalSchwartz: for me, when i get a black screen that immediately closes, i just click the launch button again and it works RandalSchwartz: i'll let you know when i'm back at the office nope - I've hit it five times in a row no good I wonder if I could trick chicken of the VNC to talk to it i wish there was something like ipmi for graphical console. so hp/dell/supermicro/etc dont' all have different interfaces/problems although they all seem to have similar annoyances with wanting to use java tbh RandalSchwartz: i've tried tricking VNC to talk to it, but even though it runs on port 5900, it is some type of Supermicro proprietary VNC, which doesn't work with regular VNC in my experience ugh probably wouldn't be too difficult to reverse engineer not like VNC is a standard or anything it's because they don't want to use password authentication hp has an emulated text console you can just ssh in and type a command and it'll show you the screen in text (as well as having seperate serial port for remote console) the hp one is kind of laggy and annoying and not wonderful, but you use it so rarely that it doesn't really matter. that is, it works. i can't relaly see supermicro suddenly going open, but maybe people should pressure them to be "feature complete" with hp/dell well. the supermicro java has a serial console feature but again, since I haven't enabled that in freebsd, I don't have it so does openipmi yeah enable it in freebsd, and you can just use ipmi console, using ipmitool. have you got a windows box you can try from? ipmitool sol works great with supermicro ipmi cards, I use it all the time plett: oonce you set it up :) mercutio: On Debian, that's just a matter of telling the grub bootloader to use a serial port as it's console plett: it doesn't help if it's not setup though afaik randal can't get into his box at all atm RandalSchwarts: use Debian? serial console in freebsd is easy too console="comconsole" Set up how? I don't recall having to set anything up in the ipmi card via the bios before hand in /boot/loader.conf GRUB_CMDLINE_LINUX="console=tty0 console=ttyS0,19200n8" in /etc/default/grub he said he was using freebsd iirc I see that was off hp box but i'm sure it's the same yea, I've used that before unless it requires a certain baud rate or something On Debian with systemd (and probably other systemd machines too) you don't have to enable the getty on the serial port, it notices that grub is using serial as the console and does it for you All hail systemd :) yesterday my systemd on Debian got into a tight loop and wouldn't do anything oh hmm, http://lists.freedesktop.org/archives/systemd-devel/2015-January/026811.html ttyu0"/usr/libexec/getty std.57600"vt100on secure think you need that in /etc/ttys it doesn't like the tabs i think and on recent freebsd there's "onifconsole" which I guess is a bit like what plett described except w/o the dbus crap :) dne: I didn't know that. How recent? I haven't seen it in 10.0 10.1 at least, and I think 9.3 That probably means that I need to upgrade one of my 10.0 test machines to 10.1 to try it yup it's in the release notes for 10.1 & 9.3 I know it's a simple edit to /boot/loader.conf, but if I screw that up, the box doesn't boot at all, I presum. so I have to have someone who can get to the console to diagnose and fix how it's broken. i think you can set it at the bootloader too but the bootloader doesn't see the serial port unless it's in that yeah it does and I can't get to the bootloader without vnc just a getty on SOL may be better that nothing? the supermicro bios outputs to serial port as well as screen oh, interesting so if I reboot the machine, but watch the serial port, I should be ok if the bios option is set at least. hmm ok - how would I verify that? :) you're booted right now right? yes, running now do you know the motherboard model? No let's just check the manual uhh something in dmesg would tell me? yeah if you still got that yes dmidecode should tell you too command not found: dmidecode there's a package i checked it was on my freebsd box i checked the serial on :) dmidecode-2.11 A tool for dumping DMI (SMBIOS) contents in human-readable where is it in dmesg? oh... I'd have to add that to my poudriere to install it i don't have a boot dmesg I don't install from fbsd pkg it's in ports as sysutils/dmidecode if that's easier? ACPI APIC Table: yeah acpi not good enough so that won't mirror to console RandalSchwartz: i have the console open, so if you want to do your thing, i'll watch ok... here we go roger open serial console as it boots woo hoo. I have cache! seems to be working fine you saw bios? no... just typed "zpool add zroot cache ad8" oh and "zpool info -v zroot" shows the cache in place sweet you have ssd? yes 120G of ssd cool. don't use 120gb for ssd cache on zfs it takes up too much ram and 864G of real disk, mirrored just a word of warning :) we got fat mem on that box too well 120gb is too much for 32gb of ram really too late. already added. :) actually, I can remove it also it isn't persistent but is there a way to just use a portion? yeah use a partition why woudln't more ssd be better? you probably only have 60gb or less of hot data anyway you can also add another cache device in addition to the first if you find it too small heh.. given I have only 120GB of data on disk, I bet yes. heh yeah unfortunately zfs's memory consumption could do work some optimisation. we could add a 256GB SSD :) even 2x 256GB SSD ;) I wonder if I should try to remove it, just to see if I can since up_the_irons is watching what freebsd version? RandalSchwartz: i still have the console open 8.4 i think removing caches wasn't implemented at the start is there a way to look at cache stats? yeah look at arcstats or zpool iostat -v yeah, watching iostat. oh... -v heh ... cache 1.68G used you can do zpool iostat -v 1 118G free :) to see it every second yeah - doing that cache - - - - - - sdg1 60.8G 19.2G 6 7 44.8K 88.3K that's off a real machine which i learnt about not having too big cache on but yeah you may be fine virtual machine true ghost in the machine so even with a 80gb cache it hasn't got up to 80gb utilisation yet. i actualyl experimented with using flash drive as cache too, it actually worked quite well for metadata. using the sandisk usb3 ones. normally ssd isn't used for bulk storage. you can adjust how fast it writes etc. but by default it basically will only try and capture random data access also depending on the ssd you're meant to short stroke them less or more but as a general rule of thumb you should be short stroking them 5 to 30% more towards 30% for cheap/old/worn/crap ssd's. and more towards 5% for high end I might be hallucinating, but it feels a bit faster already probably hallucinating it's actually quite hard to notice the difference. most issues come from writes. given sufficient ram etc. i suppose i'm a bit of a non believer. it helps a bit if you're tight on resources, but there seems to be more improvement with metadata than real data. but slog generally helps more and because it uses memory that would otherwise be used for caching to store lookups it can reduce performance. slog? zil? ahh... yeah... I recall that. should I be using this ssd for that instead? as well normally grr i can't paste atm it seems slog/zil is for writes so if I set up two partitions, used one for zil, the other for l2arc? l2arc/cache is for reads yeah but if ssd fails you can lose more data so some people say you should have two err if ssd fails at the time of power loss so slog is like bbwc but with ssd it puts synchronous writes there which means you can really improve performance of synchronous writes. but it's not used for async writes. there are tools to measure. generally speaking i'd say if you only have 120gb of data it's better to use 2x256gb ssd's and the day we did that, we'd need 257gb :) enable lz4 compression lz4 compression is also good but yeah on e3/i7 type machines i'd generally say go for 32gb of memory before considering l2arc. but if you're dual using it for other things it can still be good Oooh.. building ports... now using 8.17G of my cache! heh the question is is it data you will use again? probably not hopefully, I'm not building gcc... again. it's pretty hard to know yeah but this stuff going into cache will be stuff that was in memory before that true so it may be helping you, but no more than having 8gb more ram so far :) RandalSchwartz: do you still need me on the console? No - thank you but when I enable the serial console... I'll probably want you around in case that hoses. ... ARC: 17G Total, 3044M MFU, 12G MRU, 14M Anon, 615M Header, 1352M Other i thought that's what you were going to do while he was around? no - I was adding the cache the mfu part is cool. RandalSchwartz: i can remain on it if you want to enable serial ahh and didn't know if that would freeze the machine No - I don't want to reboot maayan right now RandalSchwartz: or we can do it later, i'm working at a client's office until like midnight tonight, so i'll be around it'll have to be closer to off hours we're still mostly west coast prime-time for neil's stuff do you have cacti randal? you can measure load average pretty easily zabbix that's one of the best ways to see what performance impact there is oh that can do that too right? yeah graphs and alerts yeah i would be curious to know what difference you find build finished dmidecode now available cool what am I looking for? Product Name SMBIOS 2.7 present. Product Name: X9SCL/X9SCM cool yeah that's better there's lots of product names which one? they'll be the same for our purposes at least oh, here's BIOS info grr is it tmux or urxvt not letting me paste no product name there serial services are supported weird it doesn't work in putty too i got the manual in front of me http://www.supermicro.com/manuals/motherboard/C202_C204/MNL-1270.pdf it's actually not loading well :( like 15k/sec look at 4-12 COM0/COM1/SOL Console Redirection Use this feature to enable console redirection for COM0 and COM1 ports. The options are Enabled and Disabled. The default for all ports are Disabled. Serial Port for Out-of-Band Management / Windows Emergency Management Services (EMS) Use this feature to enable console redirection. The options are Enabled and Disabled. The default is Disabled. so yeah it's not enabled by default, so probably has to be set I would set that using the java app? yeah in bios unless it was done when the system was provisioned. and where would that be in ipmiview does ipmiview let you access bios settings? I don't know actually - that jpmi thingy might have had something taht said bios oops no... I mean the web-based thing what is the "SOL" in "Launch SOL" i think that's serial console serial over lan Nothing says "BIOS" in the supermicro web interface mercutio: yes, you can access bios over ipmiview. it's the actual console. up_the_irons: do you enable console redirection? mercutio: yes cool well there's the answer randal up_the_irons fixes the broken supermicro defaults :) my job is to make life easier for you guys so yes ;) heh i'm used to things being broken, cynical i suppsoe haha so yeah just setting freebsd up shoudl be fine, and you shoudl be able to see freebsd boot loeader err loader mercutio: +1 for ninite. Sucks that Adobe doesnt let them bundle flash anymore, they want people to get the malware / antivirus mcafee install bloatware chocolatey is kind of like a package manager for windows, looks interesting - but ninite meets my needs at present cool i hate flash anyway chocolatey: There are 2457 packages That's what she said!! BryceBot: that's right! http://azure.microsoft.com/blog/2015/01/08/largest-vm-in-the-cloud/ 32 core, upto 448 GiB Ram and 6.5 TB of SSD storage 32core is the biggest vm? i imagine there are cloud providers with sun servers. http://www.ebay.com/itm/NEW-FACTORY-SUN-ORACLE-T5-2-2-x-3-6GHz-16-Core-32-8GBGB-256GB-2-x-300GB-DVD/121255851496?_trksid=p2047675.c100005.m1851&_trkparms=aid%3D222007%26algo%3DSIC.MBE%26ao%3D1%26asc%3D27673%26meid%3Dd7bbfaf283dc4a068f59dfe8cc7a93bf%26pid%3D100005%26prg%3D11378%26rk%3D1%26rkt%3D6%26sd%3D141185644376&rt=nc that's 32core, with 256 threads not that i'm going to buy one, but it seems surprising that no-one would be selling servers on sparc. heh i found a fujitsu server you can buy that takes 64 cpus, (16 cores per cpu i think) 32tb of ram, 128 hard-disk/ssds, 128 pci-e slots. and up to 56,290 watts of power but you can also get a 64 core 4u box. merc2: 56kW of power?! my GAWD but damn, 64 CPUs... i guess that takes some juice yeah 2 racks large too but that's one of the reason masssive arm servers have been idealised. with that kind of density it's still a bitch to cool. i mean it has liquid cooling itself, but the heat has to go somewhere. i suppose you stick it in the basement, and pipe it into the buildings heaters? mercutio: i imagine you would hook it into the existing AC chiller pipes