[00:23] *** hive-mind has quit IRC (Ping timeout: 244 seconds) [00:30] *** hive-mind has joined #arpnetworks [00:51] *** jlgaddis has joined #arpnetworks [01:57] *** hazardous has quit IRC (Ping timeout: 265 seconds) [01:58] *** hazardous has joined #arpnetworks [02:04] *** hive-mind has quit IRC (Ping timeout: 244 seconds) [02:12] *** hive-mind has joined #arpnetworks [02:45] *** dj_goku_ has joined #arpnetworks [02:45] *** dj_goku has quit IRC (Read error: Connection reset by peer) [09:57] *** technoid_ has quit IRC (Quit: (null)) [10:15] *** sjackso has joined #arpnetworks [11:27] *** technoid_ has joined #arpnetworks [12:46] I just love how I reinstalled my Windows 8 OS on my main desktop, but when I reconnect my tmux session, all my terminals, windows, weechat sessions are intact. Magical stuff [13:10] yeah tmux is handy :) [13:10] i kind of wish putty could sync sessions, fonts, etc. [13:10] did you use ninite mnathani ? it's really good for windows installs. [13:11] basically you just select from a list of programs you want installed like putty etc and it downloads/installs them. it even downloads and installs at once. [13:12] All without user interaction [13:12] yeah it's pretty amazing if you're into windows. [13:13] Extremely handy for bringing up new Windows installs. [13:13] or just want to install useful programs on someone's computer [13:14] i like it how it doesn't include too much stuff. [14:01] the other thing I love for bringing up windows installs honestly is chocolaty [14:01] I install windows, install that, and run a script to pull all of my apps from there [14:13] *** RandalSchwartz has joined #arpnetworks [14:14] gonna try to see if I can VNC into the console... again. [14:15] if not, I'm hoping up_the_irons is around. :) [14:17] haven't heard of chocolaty [14:17] everything seems to be about chocolate [14:17] was it a joke? [14:19] for the dedi machines, I want "remote control" "redirect console"? [14:20] and then "launch console" which still seems like it does nothing. :) [14:22] ahh.. right. same problem as before. unsigned java, so I can't run it at all. [14:54] RandalSchwartz: i'll be in a better position to watch the console around 4:30; i'm on a bad connection here right now [14:56] randal yeah for dedicated annoying java thingy [14:57] did you end up trying ipmi? [14:59] OK - let me know [14:59] ipmi doesn't provide the VNC-like interface I need, and serial console is not yet enabled. [14:59] RandalSchwartz: are you trying to do it in the browser? [14:59] yes [15:00] I had the same problem [15:00] I think supermicro has some jar file on their ftp [15:00] for Linux [15:00] Oh wait... I had that somewhere. [15:00] you can run with java -jar ... and it will give you a UI [15:02] ok... I have the supermicro logged in [15:02] "Launch KVM Console" pops up a black screen, then immediately closes. [15:02] I think the VNC broke for me though. it runs some libc-linked binary that wasn't compatible with my libc [15:02] ^ that [15:03] that sucks [15:03] if you look at the debug output, that's what's happening [15:03] I think I ended up just finding a Windows box to use [15:03] and the text console requires rebooting and changing a very critical file [15:04] such that if I screw it up, I don't get booted. [15:04] fun [15:05] apparently the SuperMicro remote console view thingy is actually just VNC [15:06] but with some funny authentication extension [15:06] RandalSchwartz: for me, when i get a black screen that immediately closes, i just click the launch button again and it works [15:06] RandalSchwartz: i'll let you know when i'm back at the office [15:07] nope - I've hit it five times in a row [15:07] no good [15:07] I wonder if I could trick chicken of the VNC to talk to it [15:08] i wish there was something like ipmi for graphical console. [15:08] so hp/dell/supermicro/etc dont' all have different interfaces/problems [15:08] although they all seem to have similar annoyances with wanting to use java tbh [15:14] RandalSchwartz: i've tried tricking VNC to talk to it, but even though it runs on port 5900, it is some type of Supermicro proprietary VNC, which doesn't work with regular VNC in my experience [15:15] ugh [15:15] probably wouldn't be too difficult to reverse engineer [15:15] not like VNC is a standard or anything [15:15] it's because they don't want to use password authentication [15:15] hp has an emulated text console [15:16] you can just ssh in and type a command and it'll show you the screen in text [15:16] (as well as having seperate serial port for remote console) [15:16] the hp one is kind of laggy and annoying and not wonderful, but you use it so rarely that it doesn't really matter. [15:16] that is, it works. [15:17] i can't relaly see supermicro suddenly going open, but maybe people should pressure them to be "feature complete" with hp/dell [15:19] well. the supermicro java has a serial console feature [15:20] but again, since I haven't enabled that in freebsd, I don't have it [15:21] so does openipmi [15:21] yeah enable it in freebsd, and you can just use ipmi console, using ipmitool. [15:25] have you got a windows box you can try from? [15:25] ipmitool sol works great with supermicro ipmi cards, I use it all the time [15:26] plett: oonce you set it up :) [15:26] mercutio: On Debian, that's just a matter of telling the grub bootloader to use a serial port as it's console [15:27] plett: it doesn't help if it's not setup though [15:27] afaik randal can't get into his box at all atm [15:28] RandalSchwarts: use Debian? [15:28] serial console in freebsd is easy too [15:28] console="comconsole" [15:28] Set up how? I don't recall having to set anything up in the ipmi card via the bios before hand [15:28] in /boot/loader.conf [15:28] GRUB_CMDLINE_LINUX="console=tty0 console=ttyS0,19200n8" [15:28] in /etc/default/grub [15:29] he said he was using freebsd iirc [15:29] I see [15:30] that was off hp box but i'm sure it's the same [15:30] yea, I've used that before [15:30] unless it requires a certain baud rate or something [15:31] On Debian with systemd (and probably other systemd machines too) you don't have to enable the getty on the serial port, it notices that grub is using serial as the console and does it for you [15:31] All hail systemd :) [15:32] yesterday my systemd on Debian got into a tight loop and wouldn't do anything [15:32] oh hmm, [15:33] http://lists.freedesktop.org/archives/systemd-devel/2015-January/026811.html [15:33] ttyu0"/usr/libexec/getty std.57600"vt100on secure [15:33] think you need that in /etc/ttys [15:33] it doesn't like the tabs i think [15:35] and on recent freebsd there's "onifconsole" which I guess is a bit like what plett described except w/o the dbus crap :) [15:36] dne: I didn't know that. How recent? I haven't seen it in 10.0 [15:36] 10.1 at least, and I think 9.3 [15:37] That probably means that I need to upgrade one of my 10.0 test machines to 10.1 to try it [15:39] yup it's in the release notes for 10.1 & 9.3 [15:43] I know it's a simple edit to /boot/loader.conf, but if I screw that up, the box doesn't boot at all, I presum. [15:43] so I have to have someone who can get to the console to diagnose and fix how it's broken. [15:43] i think you can set it at the bootloader too [15:43] but the bootloader doesn't see the serial port unless it's in that [15:44] yeah it does [15:44] and I can't get to the bootloader without vnc [15:44] just a getty on SOL may be better that nothing? [15:44] the supermicro bios outputs to serial port as well as screen [15:44] oh, interesting [15:44] so if I reboot the machine, but watch the serial port, I should be ok [15:44] if the bios option is set at least. [15:44] hmm [15:45] ok - how would I verify that? :) [15:45] you're booted right now right? [15:45] yes, running now [15:45] do you know the motherboard model? [15:45] No [15:45] let's just check the manual [15:45] uhh [15:45] something in dmesg would tell me? [15:45] yeah if you still got that [15:46] yes [15:46] dmidecode should tell you too [15:46] command not found: dmidecode [15:46] there's a package [15:46] i checked it was on my freebsd box i checked the serial on :) [15:46] dmidecode-2.11 A tool for dumping DMI (SMBIOS) contents in human-readable [15:47] where is it in dmesg? [15:47] oh... I'd have to add that to my poudriere to install it [15:47] i don't have a boot dmesg [15:47] I don't install from fbsd pkg [15:47] it's in ports as sysutils/dmidecode if that's easier? [15:48] ACPI APIC Table: [15:48] yeah acpi not good enough [15:48] so that won't mirror to console [15:49] RandalSchwartz: i have the console open, so if you want to do your thing, i'll watch [15:49] ok... here we go [15:50] roger [15:50] open serial console as it boots [15:50] woo hoo. I have cache! [15:51] seems to be working fine [15:51] you saw bios? [15:51] no... just typed "zpool add zroot cache ad8" [15:51] oh [15:51] and "zpool info -v zroot" shows the cache in place [15:51] sweet [15:51] you have ssd? [15:52] yes [15:52] 120G of ssd [15:52] cool. [15:52] don't use 120gb for ssd cache on zfs [15:52] it takes up too much ram [15:52] and 864G of real disk, mirrored [15:52] just a word of warning :) [15:52] we got fat mem on that box too [15:53] well 120gb is too much for 32gb of ram really [15:53] too late. already added. :) [15:53] actually, I can remove it [15:53] also it isn't persistent [15:53] but is there a way to just use a portion? [15:53] yeah use a partition [15:53] why woudln't more ssd be better? [15:54] you probably only have 60gb or less of hot data anyway [15:54] you can also add another cache device in addition to the first if you find it too small [15:55] heh.. given I have only 120GB of data on disk, I bet yes. [15:55] heh [15:55] yeah unfortunately zfs's memory consumption could do work some optimisation. [15:55] we could add a 256GB SSD :) [15:55] even 2x 256GB SSD ;) [15:55] I wonder if I should try to remove it, just to see if I can [15:55] since up_the_irons is watching [15:55] what freebsd version? [15:55] RandalSchwartz: i still have the console open [15:55] 8.4 [15:56] i think removing caches wasn't implemented at the start [15:56] is there a way to look at cache stats? [15:56] yeah look at arcstats [15:56] or zpool iostat -v [15:57] yeah, watching iostat. [15:57] oh... -v [15:57] heh ... cache 1.68G used [15:57] you can do zpool iostat -v 1 [15:57] 118G free :) [15:57] to see it every second [15:57] yeah - doing that [15:57] cache - - - - - - [15:57] sdg1 60.8G 19.2G 6 7 44.8K 88.3K [15:57] that's off a real machine [15:58] which i learnt about not having too big cache on [15:58] * mercutio wonders how you can have a not real machine [15:58] but yeah you may be fine [15:58] virtual machine [15:58] true [15:58] ghost in the machine [15:59] so even with a 80gb cache it hasn't got up to 80gb utilisation yet. [15:59] i actualyl experimented with using flash drive as cache too, it actually worked quite well for metadata. [15:59] using the sandisk usb3 ones. [16:00] normally ssd isn't used for bulk storage. [16:00] you can adjust how fast it writes etc. [16:00] but by default it basically will only try and capture random data access [16:00] also depending on the ssd you're meant to short stroke them less or more [16:01] but as a general rule of thumb you should be short stroking them 5 to 30% [16:02] more towards 30% for cheap/old/worn/crap ssd's. [16:03] and more towards 5% for high end [16:04] I might be hallucinating, but it feels a bit faster already [16:04] probably hallucinating [16:04] it's actually quite hard to notice the difference. most issues come from writes. [16:05] given sufficient ram etc. [16:05] i suppose i'm a bit of a non believer. it helps a bit if you're tight on resources, but there seems to be more improvement with metadata than real data. [16:06] but slog generally helps more [16:08] and because it uses memory that would otherwise be used for caching to store lookups it can reduce performance. [16:08] slog? [16:09] zil? [16:09] ahh... yeah... I recall that. [16:09] should I be using this ssd for that instead? [16:09] as well normally [16:10] grr i can't paste atm it seems [16:10] slog/zil is for writes [16:10] so if I set up two partitions, used one for zil, the other for l2arc? [16:10] l2arc/cache is for reads [16:10] yeah [16:10] but if ssd fails you can lose more data [16:10] so some people say you should have two [16:10] err if ssd fails at the time of power loss [16:11] so slog is like bbwc [16:11] but with ssd [16:11] it puts synchronous writes there [16:11] which means you can really improve performance of synchronous writes. [16:11] but it's not used for async writes. [16:11] there are tools to measure. [16:12] generally speaking i'd say if you only have 120gb of data it's better to use 2x256gb ssd's [16:13] and the day we did that, we'd need 257gb :) [16:13] enable lz4 compression [16:13] lz4 compression is also good [16:16] but yeah on e3/i7 type machines i'd generally say go for 32gb of memory before considering l2arc. [16:17] but if you're dual using it for other things it can still be good [16:18] Oooh.. building ports... now using 8.17G of my cache! [16:18] heh [16:18] the question is is it data you will use again? [16:18] probably not [16:19] hopefully, I'm not building gcc... again. [16:19] it's pretty hard to know [16:19] yeah but this stuff going into cache will be stuff that was in memory before that [16:19] true [16:19] so it may be helping you, but no more than having 8gb more ram so far :) [16:19] RandalSchwartz: do you still need me on the console? [16:19] No - thank you [16:20] but when I enable the serial console... I'll probably want you around in case that hoses. [16:20] ... ARC: 17G Total, 3044M MFU, 12G MRU, 14M Anon, 615M Header, 1352M Other [16:20] i thought that's what you were going to do while he was around? [16:20] no - I was adding the cache [16:20] the mfu part is cool. [16:20] RandalSchwartz: i can remain on it if you want to enable serial [16:20] ahh [16:20] and didn't know if that would freeze the machine [16:21] No - I don't want to reboot maayan right now [16:21] RandalSchwartz: or we can do it later, i'm working at a client's office until like midnight tonight, so i'll be around [16:21] it'll have to be closer to off hours [16:21] we're still mostly west coast prime-time for neil's stuff [16:21] do you have cacti randal? [16:22] you can measure load average pretty easily [16:22] zabbix [16:22] that's one of the best ways to see what performance impact there is [16:22] oh that can do that too right? [16:22] yeah [16:22] graphs and alerts [16:22] yeah [16:22] i would be curious to know what difference you find [16:23] build finished [16:24] dmidecode now available [16:24] cool [16:24] what am I looking for? [16:24] Product Name [16:24] SMBIOS 2.7 present. [16:24] Product Name: X9SCL/X9SCM [16:24] cool yeah that's better [16:25] there's lots of product names [16:25] which one? [16:25] they'll be the same [16:25] for our purposes at least [16:25] oh, here's BIOS info [16:25] grr is it tmux or urxvt not letting me paste [16:26] no product name there [16:26] serial services are supported [16:26] weird it doesn't work in putty too [16:26] i got the manual in front of me [16:27] *** merc2 has joined #arpnetworks [16:27] http://www.supermicro.com/manuals/motherboard/C202_C204/MNL-1270.pdf [16:28] it's actually not loading well :( [16:29] like 15k/sec [16:31] look at 4-12 [16:31] COM0/COM1/SOL Console Redirection [16:32] Use this feature to enable console redirection for COM0 and COM1 ports. The options [16:32] are Enabled and Disabled. The default for all ports are Disabled. [16:32] Serial Port for Out-of-Band Management / Windows Emergency [16:32] Management Services (EMS) [16:32] Use this feature to enable console redirection. The options are Enabled and Disabled. [16:32] The default is Disabled. [16:32] so yeah it's not enabled by default, so probably has to be set [16:33] I would set that using the java app? [16:33] yeah [16:33] in bios [16:33] unless it was done when the system was provisioned. [16:35] and where would that be in ipmiview [16:35] does ipmiview let you access bios settings? [16:36] I don't know [16:36] * RandalSchwartz grins [16:37] actually - that jpmi thingy might have had something taht said bios [16:37] oops no... I mean the web-based thing [16:38] what is the "SOL" in "Launch SOL" [16:38] i think that's serial console [16:39] serial over lan [16:39] Nothing says "BIOS" in the supermicro web interface [16:45] mercutio: yes, you can access bios over ipmiview. it's the actual console. [16:46] up_the_irons: do you enable console redirection? [16:46] mercutio: yes [16:46] cool well there's the answer randal [16:46] up_the_irons fixes the broken supermicro defaults :) [16:46] my job is to make life easier for you guys [16:46] so yes [16:47] ;) [16:47] heh [16:47] i'm used to things being broken, cynical i suppsoe [16:47] haha [16:48] so yeah just setting freebsd up shoudl be fine, and you shoudl be able to see freebsd boot loeader [16:48] err loader [17:05] mercutio: +1 for ninite. Sucks that Adobe doesnt let them bundle flash anymore, they want people to get the malware / antivirus mcafee install bloatware [17:06] chocolatey is kind of like a package manager for windows, looks interesting - but ninite meets my needs at present [17:08] cool [17:08] i hate flash anyway [17:59] chocolatey: There are 2457 packages [17:59] That's what she said!! [17:59] BryceBot: that's right! [18:04] http://azure.microsoft.com/blog/2015/01/08/largest-vm-in-the-cloud/ [18:04] 32 core, upto 448 GiB Ram and 6.5 TB of SSD storage [18:05] 32core is the biggest vm? [18:05] i imagine there are cloud providers with sun servers. [18:08] http://www.ebay.com/itm/NEW-FACTORY-SUN-ORACLE-T5-2-2-x-3-6GHz-16-Core-32-8GBGB-256GB-2-x-300GB-DVD/121255851496?_trksid=p2047675.c100005.m1851&_trkparms=aid%3D222007%26algo%3DSIC.MBE%26ao%3D1%26asc%3D27673%26meid%3Dd7bbfaf283dc4a068f59dfe8cc7a93bf%26pid%3D100005%26prg%3D11378%26rk%3D1%26rkt%3D6%26sd%3D141185644376&rt=nc [18:08] that's 32core, with 256 threads [18:12] not that i'm going to buy one, but it seems surprising that no-one would be selling servers on sparc. [18:16] heh i found a fujitsu server you can buy that takes 64 cpus, (16 cores per cpu i think) 32tb of ram, 128 hard-disk/ssds, 128 pci-e slots. [18:16] and up to 56,290 watts of power [18:17] but you can also get a 64 core 4u box. [19:09] merc2: 56kW of power?! my GAWD [19:10] but damn, 64 CPUs... i guess that takes some juice [19:11] yeah 2 racks large too [19:11] but that's one of the reason masssive arm servers have been idealised. [19:11] with that kind of density it's still a bitch to cool. [19:11] i mean it has liquid cooling itself, but the heat has to go somewhere. [19:12] i suppose you stick it in the basement, and pipe it into the buildings heaters? [19:34] mercutio: i imagine you would hook it into the existing AC chiller pipes [20:13] *** novae has quit IRC (Ping timeout: 264 seconds) [20:17] *** novae has joined #arpnetworks [21:56] *** dj_goku_ has quit IRC (Ping timeout: 264 seconds) [22:11] *** dj_goku has joined #arpnetworks [23:01] *** dj_goku has quit IRC (Ping timeout: 240 seconds) [23:06] *** dj_goku has joined #arpnetworks [23:06] *** dj_goku has quit IRC (Changing host) [23:06] *** dj_goku has joined #arpnetworks [23:21] *** eryc has quit IRC (Ping timeout: 255 seconds) [23:22] *** eryc has joined #arpnetworks [23:22] *** eryc has quit IRC (Changing host) [23:22] *** eryc has joined #arpnetworks