#arpnetworks 2012-08-17,Fri

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***Webhostbudd has joined #arpnetworks [01:11]
...... (idle for 29mn)
gcw|mini1 has joined #arpnetworks
LT has joined #arpnetworks
gcw|mbpro has quit IRC (Ping timeout: 246 seconds)
[01:40]
....... (idle for 34mn)
Webhostbudd has quit IRC (Ping timeout: 250 seconds) [02:16]
.................................................... (idle for 4h17mn)
fink has joined #arpnetworks [06:33]
up_the_ironsjlgaddis: no web frontend to powerdns, it just powers my Reverse DNS manager
jdoe: mercutio : the comparable Intel stuff is sexy too, but way expensive
[06:36]
mercutioup_the_irons: do the new cpus support bulldozer?
err i mean are they bulldozer
i actually have no ideahow much cpu ssh would be taking up
but i like the idea of it being accelerated :0
[06:43]
up_the_ironsmercutio: they are bulldozer, yes. would ssh even take advantage of the hardware aes-ni? like, how would it know it's there.. probably need a new version of ssh [06:47]
LTif it's anything like the old VIA AES instructions it just requires the right openssl setup for most things to use it [06:50]
up_the_ironsah cool [06:51]
LT'openssl engine' [06:53]
***irons|xchat has quit IRC (Ping timeout: 246 seconds)
HighJinx has quit IRC (*.net *.split)
arenlor has quit IRC (*.net *.split)
teneightypea_ has quit IRC (*.net *.split)
dferris has quit IRC (*.net *.split)
Igneous has quit IRC (*.net *.split)
[06:55]
mercutioup_the_irons: openssl needs to be up to date [06:56]
***arenlor has joined #arpnetworks [06:57]
mercutiolt: ubuntu doesn't show it in openssl engine now
do you have one of those cpus now?
[06:57]
***HighJinx has joined #arpnetworks
dferris has joined #arpnetworks
Igneous has joined #arpnetworks
[06:57]
mercutioopenssl speed -evp aes-256-cbc
you want to run that command
type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes
[06:57]
***teneightypea has joined #arpnetworks [06:58]
mercutioaes-256-cbc 202878.63k 208678.91k 206311.52k 225509.62k 222816.90k
if it's anything like as high as that it's accelerated
if it's more like:
type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes
aes-256-cbc 73896.75k 74157.50k 75189.17k 75321.54k 75582.84k
then it's not
[06:58]
LThmm rhel stilll shows it in engine
aes-256-cbc 614184.36k 684397.85k 696434.09k 699525.12k 701133.83k
[07:00]
mercutiothat's accelerated numbers :) [07:00]
***fink has quit IRC (Quit: fink) [07:00]
mercutioactually i wonder if that first one is accelerating properly
type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes
aes-256-cbc 164786.10k 183756.50k 189753.15k 190754.71k 191059.91k
cos that's the number of non accelerated core 2 duo
[07:00]
LTactually mine wasn't accelerated... [07:03]
mercutioreally?
how come?
options:bn(64,64) rc4(16x,int) des(idx,cisc,16,int) aes(partial) blowfish(idx)
# openssl engine
(rsax) RSAX engine support
(dynamic) Dynamic engine loading support
is there something else that has to be done too?
[07:03]
LThmm... you have me wondering now [07:05]
mercutiothe first number is xeon e5420
actually xeon E5345
model name : Intel(R) Xeon(R) CPU E5345 @ 2.33GHz
and you''re like nearly 10 as fast
type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes
aes-256-cbc 134099.06k 152144.10k 157358.49k 158168.27k 157409.28k
e5420 is quite a bit faster
actually i wonder if i'm accelerated properly
https://bugs.launchpad.net/ubuntu/+source/openssl/+bug/1001424
type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes
aes-256-cbc 213802.95k 687449.25k 1094622.32k 1083138.24k 1088128.52k
[07:06]
LToh yeah it is accelerating, I thought I could trick it by setting -engine to something else but it seems to load the engine anyway [07:12]
mercutioit's a lot quicker when you pass -decrypt
-decrypt time decryption instead of encryption (only EVP).
The 'numbers' are in 1000s of bytes per second processed.
type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes
aes-256-cbc 59636.47k 41641.90k 141532.70k 150321.79k 152577.39k
but e5345 still sucks at decrypt
[07:12]
LTaes-256-cbc 613619.75k 1452257.90k 1860791.98k 1988995.41k 2028642.30k [07:14]
mercutiolt: what cpu is that? [07:14]
LTX5690 [07:14]
mercutiohmm
oh that's really high ghz isn't it?
3.47ghz ?
versus 2 ghz
it's the first intel series to support aes-ni i think
wow those things are expensive :/
[07:14]
LTyes... but useful if you're stuck running something single threaded [07:20]
mercutiolike dos?
the new e5s latency reduction thing sounds intersting
i suppose it'll come into desktops soon
opteron 6276 seems similar speed to x5650
e5-2690 is like 50% faster
but e5-2690 is like what the recent version of what you're using
ie: expensive :/
it's also power hungry
http://www.anandtech.com/print/5553
reading that
what opteron 6276 is expensive too :/
[07:21]
***fink has joined #arpnetworks
fink has quit IRC (Client Quit)
[07:26]
mercutiooh it's cheaper than X5670
and X5690 isn't even sold here :/
[07:26]
LTthe latest new thing always is expensive - we tend to wait until the next new thing is out then buy up the best of the last generation on the cheap [07:27]
mercutioahh i see
i prefer lower spec newer stuff generally
but end up with lower spec older stuff :/
the e5-2620 is actually pretty good value
and all the opterons seem to be branded hp
up_the_irons: what cpus are in the kvm nodes atm? kvm hides the cpu type
it says 2.641 ghz
but that's about as much
x3450?
i'm guessing it's 2.66ghz
or e5430
or e5150
[07:28]
you have to tell ssh to use aes
otherwise it defaults to blowfish
without acceleration aes256-cbc and blowfish are about the same speed and aes128-cbc is faster
and ptuty defaults to aes rater than blowfish
[07:45]
LTopenssh defaults to aes128... [07:49]
mercutiodoes it?
aes128-cbc?
Ciphers aes128-ctr,aes192-ctr,aes256-ctr,arcfour256,arcfour128,aes128-cbc,3des-cbc
i actually foudn this
commented out
blowfish isn't even in that last?
but if i change that first entry to be aes128-cbc ssh to localhost with dd'ed zero data is faster
oh hmm
that really isn't a good test is it
[07:49]
LTdefault is in the ssh_config man page... probably varies due to version, but aes has been preferred for many many versions [07:51]
mercutioit's aes128-ctr versus aes128-cbc?
what's the diff
i was reading something old that said blowfish default :)
[07:51]
LTone is ctr mode one is cbc mode :p
ctr is meant to be easily parallelisable, cbc isn't
[07:52]
mercutio209715200 bytes (210 MB) copied, 6.54909 s, 32.0 MB/s
versus
209715200 bytes (210 MB) copied, 2.4191 s, 86.7 MB/s
and non-zero file
oh?
first is ctr second is cbc
dd if=/var/www/testfile.zip bs=1024k | ssh -c aes128-cbc root@localhost 'dd of=/dev/null'
hmm# gzip -cv /var/www/testfile.zip| wc
/var/www/testfile.zip: -0.0% 820474 4625767 209749312
so non compressable
it would be nice to be like more than 50% faster than that :)
so that ssh can be liek gigabit speeds with encrpytion
[07:54]
LTif you want fast ssh you need the hpn version - that actually has a parallel version of aes-ctr [08:04]
mercutiooh?
i don't really need faster ssh
i was just curious how much diff these acceleration things made
and i'm not getting a lot of diff
aes128-cbc is faster than aes128-ctr on xeon e5435 too though..
[08:04]
LTmaybe there's no acceleration for ctr but there is for cbc? dunno [08:06]
mercutiodoes the hpn version work on openbsd?
xeon 5435 has no acceleration aynway
err i meant 5345
but i think that could be right too LT
cos i foudn a rhel bug about such, i cant' acecss it though to see more about it
[08:06]
LTcbc is a pretty standard way of doing things that's been around for ages, but ctr is newer and I think the ssh people might even have invented it [08:10]
mercutiohmm
well the ssh people took out the none cypher
i like the idea of encrypting auth but not data :)
[08:10]
LTthe hpn version adds none back [08:12]
mercutioahh
i do slightly remember hpn from ages back
when ssh had window size limitations
that made international transfer speeds always suck
back then it was always behind ssh by quite a few verisons
[08:12]
LThttp://www.cl.cam.ac.uk/~rja14/book.html is a great free book for understanding the differences between cbc, ctr, etc as an aside [08:14]
mercutiocool i'll bookmark it
hmm dd over ssh is faster than scp
[08:14]
***ix33 has quit IRC (Read error: Operation timed out) [08:19]
mercutioi do actualyl want to understand encrpytion sometime .. especially with regards to interactive ssh type applications [08:19]
***notion has quit IRC (Read error: Operation timed out) [08:19]
mercutio(ie not much data.. data could be guessed by delays between keystrokes etc) [08:19]
***notion has joined #arpnetworks
ix33 has joined #arpnetworks
[08:19]
........ (idle for 39mn)
LT has quit IRC (Quit: Leaving) [08:58]
........... (idle for 54mn)
hive-min1 has quit IRC (Ping timeout: 268 seconds)
hive-mind has joined #arpnetworks
[09:52]
up_the_ironstype 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes
aes-256-cbc 279385.84k 277993.37k 301771.51k 318107.50k 319316.99k
mercutio: ^^
AMD 6216
mercutio: the kvm nodes are dual E5430's
these are numbers on the E5430's (no acceleration)
type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes
aes-256-cbc 95563.29k 106319.22k 110646.64k 112421.96k 106064.11k
[10:05]
***fink has joined #arpnetworks
HighJinx has quit IRC (Quit: Computer has gone to sleep.)
[10:13]
up_the_ironsjeez
Intel Xeon E5-2660 Sandy Bridge-EP 2.2GHz
[10:15]
***irons|xchat has joined #arpnetworks [10:16]
up_the_irons$1329
all i can is
Fuck That(tm)
*say is
[10:16]
***hive-mind has quit IRC (Ping timeout: 272 seconds)
hive-mind has joined #arpnetworks
[10:17]
hive-mind has quit IRC (Ping timeout: 240 seconds)
hive-mind has joined #arpnetworks
[10:26]
fink has quit IRC (Quit: fink)
hive-mind has quit IRC (Ping timeout: 268 seconds)
HighJinx has joined #arpnetworks
atmark has joined #arpnetworks
fink has joined #arpnetworks
hive-mind has joined #arpnetworks
hive-min1 has joined #arpnetworks
hive-mind has quit IRC (Ping timeout: 245 seconds)
fink has quit IRC (Quit: fink)
fink has joined #arpnetworks
gcw|mini1 has quit IRC (Remote host closed the connection)
fink has quit IRC (Client Quit)
[10:32]
gcw|mbpro has joined #arpnetworks [11:07]
........ (idle for 38mn)
Webhostbudd has joined #arpnetworks
fink has joined #arpnetworks
[11:45]
..................... (idle for 1h42mn)
mtve has quit IRC (Ping timeout: 244 seconds) [13:27]
phlux3:28PM up 391 days, 17:36, 4 users, load averages: 0.05, 0.06, 0.01 [13:28]
***gcw|mbpro has quit IRC (Ping timeout: 272 seconds) [13:28]
phlux^My ARPNetworks FreeBSD VPS...I think I'm going to be starting it from scratch soon :( [13:28]
up_the_irons$ uptime
13:49:07 up 958 days, 13:37, 3 users, load average: 4.09, 4.76, 4.38
kvr04 went up to 983 days, my longest box ever
[13:30]
phluxgood lord [13:31]
up_the_ironsmaybe this one will surpass it [13:31]
phluxam I on that box, by chance? [13:31]
up_the_ironsthat's kvr05
check your vnc host, says what box you're on
[13:31]
phluxI honestly don't even know what I'm on
Roger that, one second
bah
I don't know my VNC host :[13:33] <phlux> I thought it would be in the dashboard somewhere
oh wait, it is
I'm on kvr06
[13:31]
up_the_ironsah [13:34]
phluxphlux is kevinthompson [13:34]
up_the_ironsthat's a long running host too
$ uptime
13:07:43 up 934 days, 10:01, 2 users, load average: 3.10, 3.23, 3.31
[13:35]
phluxnice
Hopefully it keeps it up :P
[13:35]
up_the_irons:) [13:35]
twobitha1kerall that time with no kernel security patches :D [13:35]
phluxMy ARPNetworks VPS is the hub of my entire network because of its stability
I've got VPSes from elsewhere, and they don't really compare imo
I've considered moving my entire network to ARPNetworks, but I don't know how much sense that would make for me.
[13:35]
up_the_ironsphlux: :)
phlux: i say "do it"
[13:36]
phluxhaha, I bet!
If I could ensure that my servers were all on different hosts, I will be convinced to swap over everything.
[13:36]
up_the_ironstwobitha1ker: i knew someone would say that... [13:37]
phluxSomeone says that to me about my VPS, too
I tell them to go ahead and exploit it for me right quick
[13:37]
up_the_ironsthat's what you always hear when u try to tout uptime
phlux: LOL hahaha
[13:37]
phluxThey always answer "Sure give me a shell." It doesn't work that way. If I did that, I'd be giving you a head start. [13:38]
up_the_ironsphlux: well, we *do* put VMs of the same customer on different hosts, by default. [13:38]
phluxNo kidding?
So if I picked up 3 more at the same time, all 3 would be on separate hosts?
[13:38]
up_the_ironsthis one dude got like 15 VMs, in one day, and that was the only time it was hard to make sure they all got spread out
phlux: sure of course
[13:39]
phluxIf so, I am going to make that change on Sep 1 (which also happens to be my birthday, yay me!)
Awesome
It's going to be so much easier paying one company :P
[13:39]
up_the_ironsphlux: i understand the concern about not having all eggs in one basket, i practice that myself, so why not do it for the customers? [13:39]
finkphlux: see if you can negotiate for an arpnetworks tshirt
fink has tried yet failed :(
[13:40]
phluxup_the_irons: I'm glad to hear that you do it that way.
lol fink
YEAH
3 servers for 1 T-shirt
whaddya say?!
[13:40]
up_the_ironsphlux: i wish i knew that was your only concern, i would have addressed it earlier :) [13:40]
phluxup_the_irons: No worries. I originally signed up a long time ago with the intention of "testing the waters," and I ended up using that VPS for *everything* [13:41]
up_the_ironsphlux: haha cool [13:41]
phluxSpeaking of which, I'm teaching a guy some things, and he's most likely going to pick up a VPS from ARP in the coming days.
Hoping his introduction to programming goes smoothly..he wants to be an IT Commisioned Officer in the USCG. I'm waiting for him so we can try to go to OCS together. We're both already enlisted, so we wouldn't really be competing with eachother.
[13:42]
up_the_ironsI got invited to OCS, then saw the age cutoff was 29. I officially felt old (I'm 33)
i hunger, cd $food
[13:45]
phluxDang I didn't know that the cutoff was 29
I'm only 23 (as stated earlier, 24 soon) so I haven't had to worry about age limits for anything, yet
[13:47]
kraiguup_the_irons: child :D
I was considering re-careering here as a direct entry officer, but the Canadian Forces dropped signing bonuses and I couldn't afford the pay cut without one
[13:48]
phluxMan, if I'd have joined a year earlier, I'd have got a signing bonus with the CG.
I became an MST (Marine Science Technician)
I deal with oil spills, HAZMAT releases, waterfront facility regulations, foreign and domestic vessel inspections, and container inspections.
That's a mouthfull.
[13:50]
kraigualso I suggested this possibility to my wife and her reaction was nearly as violent as I could expect in Kandahar :[13:50] <milki> o.O
?
[13:50]
***hive-min1 has quit IRC (Ping timeout: 240 seconds) [13:55]
arenlorup_the_irons: Given that kvr05 has 934 days uptime, how is its health? [13:57]
***hive-mind has joined #arpnetworks [14:02]
..... (idle for 23mn)
up_the_ironskraigu: lol
arenlor: health looks good; there are a couple drives with reallocated sectors, but i did a raid verify (twice) on it, and everything checked out; so, i'm just watching it
phlux: that sounds interesting, actually
[14:25]
arenlorup_the_irons: Alright, given that my important eggs are on it, don't care to have it go down too suddenly ^_^ [14:27]
up_the_ironsphlux: you will have to worry about age limit for American Idol soon (26, i think ;)
arenlor: i hear ya. i don't want a repeat of kvr04, where i spent all day and night at the data center nursing it back to health
[14:27]
...... (idle for 26mn)
***Webhostbudd has quit IRC (Quit: Leaving) [14:54]
...... (idle for 27mn)
rykup_the_irons: well they do say natural breastfeeding is better than the bottle, so good job [15:21]
up_the_ironslol [15:21]
***mtve has joined #arpnetworks
fink has quit IRC (Quit: fink)
[15:35]
..... (idle for 21mn)
dj_goku has joined #arpnetworks [15:57]
fink has joined #arpnetworks
atmark has quit IRC (Ping timeout: 252 seconds)
[16:02]
..... (idle for 23mn)
fink has quit IRC (Quit: fink)
Webhostbudd has joined #arpnetworks
[16:27]
hive-min1 has joined #arpnetworks
hive-mind has quit IRC (Ping timeout: 244 seconds)
[16:35]
mercutioup_the_irons: e5-2620 is a lot cheaper than e5-2660
and your e5430 results seem a little low
ie i got higher results than that from e5420
it may be openssl version, or it may be load / context switching overhead
[16:40]
........ (idle for 38mn)
***DataCable has joined #arpnetworks
dj_goku has quit IRC (Ping timeout: 244 seconds)
DataCable has quit IRC (Client Quit)
[17:20]
CaZe has quit IRC () [17:31]
...... (idle for 26mn)
dj_goku has joined #arpnetworks
dj_goku has quit IRC (Changing host)
dj_goku has joined #arpnetworks
[17:57]
dj_goku has quit IRC (Ping timeout: 244 seconds) [18:06]
.......... (idle for 46mn)
HighJinx has quit IRC (Quit: Computer has gone to sleep.) [18:52]
........ (idle for 36mn)
Webhostbudd_ has joined #arpnetworks
Webhostbudd has quit IRC (Ping timeout: 250 seconds)
[19:28]
...... (idle for 29mn)
up_the_ironsmercutio: well, that was on a production server, hardly idle [19:59]
....... (idle for 33mn)
mercutioyeh load could create that
it could be related to openssl version too
OpenSSL 1.0.1c 10 May 2012
is what i was using
err actually it was 1.01
1.0.1
i think openssl changed a bit recently
[20:32]
....... (idle for 31mn)
***fink has joined #arpnetworks [21:04]
hive-mind has joined #arpnetworks
hive-min1 has quit IRC (Ping timeout: 260 seconds)
[21:12]
hive-mind has quit IRC (Ping timeout: 240 seconds)
hive-mind has joined #arpnetworks
[21:19]
hive-mind has quit IRC (Ping timeout: 245 seconds)
hive-mind has joined #arpnetworks
[21:26]
.............. (idle for 1h7mn)
up_the_ironsmercutio: i was using 0.9.8something [22:35]
jpalmerup_the_irons: less talking.. more testing centos images or spending time with your family.
;)
jpalmer ducks and runs
[22:36]
up_the_ironsi'm researching ways of exporting a block device from one host to another (say an lvm volume from one host to some /dev/foo on another). i've used AoE before, but things these days seem to be leaning toward iSCSI. Anyone have any thoughts on the matter?
jpalmer: lol
jpalmer: the kids are asleep:)
same with the wife
[22:36]
jpalmeriscsi is the new hotness. do it! [22:37]
up_the_ironsbrb [22:37]
jpalmerI think I'ma head to bed.
night all
[22:39]
up_the_irons'nite [22:43]
.... (idle for 16mn)
mercutioup_the_irons: think newer versions have improved by a bit
up_the_irons: with iscsi you want to have seperate network for it and use large mtus
balancing can be annoying, you c an use either multiple gigabit or expensive 10 gigabit
but with gigabit you limit top speed to 110mb/sec or something
fibre channel is the other option that is affordable
but most of the affordable stuff ise second hadn
and 10 gigabit ethernet is coming down in cost
that said 100mb/sec is racing, if access times are good
[22:59]
up_the_ironsmercutio: i c
mercutio: separate network is no problem, large mtus no problem
pretty easy to bond 2 gige's, but fc would be better
mercutio: have you used any iscsi targets that you would deem reliable?
[23:03]
mercutioonly opensolaris [23:09]
up_the_ironsinteresting [23:09]
mercutioand that's in state of "uhh what's happening" [23:09]
up_the_ironswut?:) [23:09]
mercutiowell when oracle bought sun
everyone left
err a lot of the higher up people left
there was a fork to illumos
[23:09]
up_the_ironsah [23:10]
Webhostbudd_the illumos camp is hopping [23:10]
mercutioopenindiana is going between prereleases... [23:10]
Webhostbudd_it's the only place to be [23:10]
up_the_ironsoh, would you look at that... who has illumosvps.com (me) [23:10]
mercutioopenindiana seems stable with ok hardware
stable as in reliable
[23:10]
Webhostbudd_they have a lot of sun people working there so we should see some good stuff [23:10]
mercutiobut not stable as in "one version for years"
yeh
[23:10]
Webhostbudd_well, no [23:11]
mercutiosmartos sounds interesting too [23:11]
Webhostbudd_smartos is a great concept [23:11]
up_the_ironsdang, i have openindianavps.com too [23:11]
mercutiomd3000i is around for iscsi support but is slow [23:11]
up_the_ironsi musta been looking toward the future... ;) [23:11]
mercutiothere are higher cost options too
hmm
well joyent ported kvm to illumos
[23:11]
Webhostbudd_it runs very well [23:12]
up_the_ironsholy shit, they did? [23:12]
Webhostbudd_yes [23:12]
mercutioyeh [23:12]
up_the_ironswow
runs good?
[23:12]
Webhostbudd_that's what i have heard [23:12]
mercutiothe base tools haven't had the work they need
but the raw support is stable
[23:12]
Webhostbudd_yes
exactly
once they port libvirt
[23:12]
mercutioeven though they ported it quickly [23:12]
Webhostbudd_it is going to be very attractive [23:12]
mercutioshowing that they have good engineers [23:12]
Webhostbudd_they have a lot of the old sun guys
because of the mass exodus from oracle
[23:13]
mercutioby good poeple leaving oracle
people like the guy who made java left
[23:13]
Webhostbudd_mhmm [23:13]
up_the_ironssmartos _does_ sound interesting [23:13]
Webhostbudd_all of the zfs, dtrace and other solaris kernel specialists left [23:13]
mercutioand said how he was unhappy with the direction oracle were taking sun
and you'd think someone like that isn't likely to be someone who would motuh off randomly
[23:13]
Webhostbudd_they aren't
they LEFT
[23:14]
mercutiohttp://www.eweek.com/c/a/Application-Development/Java-Creator-James-Gosling-Why-I-Quit-Oracle-813517/
yeh but i mean it's not like a straight business man leaving or something
and saying about his new venture
[23:14]
Webhostbudd_no, they just don't want to be a part of the lawnmower
up_the_irons: i could totally see you running smartos one day
up_the_irons: assuming it becomes stable
[23:15]
up_the_ironsWebhostbudd_: i'm checking it out right now [23:16]
Webhostbudd_what's funny is that their port of KVM requires the use of zones
so each kvm instance is wrapped in a zone
oddly enough it prevents a lot of kvm exploits
because the attacker can't break the zone
[23:16]
mercutioi think that was a sensible move [23:17]
Webhostbudd_yes it was
i mean, why not
it gives the administrator even more control over the virtual instance
[23:17]
mercutioand with zfs you can clone file systems
and do copy on write
[23:17]
Webhostbudd_zfs is amazing [23:17]
mercutioso it's not as high overhead having heaps of zones [23:17]
Webhostbudd_smartos is a killer combination of technologies
i would love to see it get bigger
[23:18]
mercutiowebhost: marketing on the other hand...
have you seen their videos?
[23:18]
Webhostbudd_no? [23:18]
mercutiothey seem tacky [23:18]
Webhostbudd_it's pretty hard to market it at this point though
let's be honest, they don't have a product to ship
[23:18]
mercutioi think they do?
joyent are doing private clouds already
[23:19]
up_the_ironsso does smartos run illumos underneath? [23:19]
mercutiohttp://joyent.com/solutions/privatecloud/ [23:19]
Webhostbudd_no one who is concerned with how they market a product is going to call that a product [23:19]
mercutioup_the_irons: yeh [23:19]
Webhostbudd_up_the_irons: yes [23:19]
mercutioand is one of the major contributors [23:19]
up_the_ironsand illumos is an opensolaris fork? [23:19]
Webhostbudd_illumos is the kernel if i am not mistaken
or do they do userland work?
[23:19]
mercutioillumus is like the base system
like netbsd etc i think
[23:19]
Webhostbudd_yea, that was always my impression [23:20]
up_the_ironsyeah i think i get it [23:20]
Webhostbudd_except they don't actually assemble any of it [23:20]
mercutioopenindiana is more like opensolaris [23:20]
Webhostbudd_i wanna say it would be like GNU finishing a kernel [23:20]
mercutiothere's also nexenta
or something
which uses apt-get
[23:20]
Webhostbudd_the way i see it, GNU = illumos and OI / nexenta are distros
IF GNU had a kernel
[23:20]
up_the_ironsso, with zones, i've always thought of them to be the solaris equivalent of freebsd jails. and since they are just processes that share the same base OS kernel, is it true the only thing you can put in a zone is another illumos instance? [23:21]
Webhostbudd_up_the_irons: mostly true [23:21]
mercutioup_the_irons: i think it's like freebsd jails, but a bit more brokenout [23:21]
up_the_irons(and that instance could run kvm, yeah, but in the end, it's still illumos) [23:21]
Webhostbudd_yes [23:21]
up_the_ironsroger [23:21]
Webhostbudd_but there is probably work to emulate linux / bsd systemcalls
i know freebsd jails can run centos
with linux emulation
[23:21]
mercutioweb: i think that work is still behind [23:22]
Webhostbudd_maybe [23:22]
mercutiosmartos is getting a new package manager i think [23:22]
Webhostbudd_i don't use zones so i wouldn't know [23:22]
mercutioand packages can be old at present [23:22]
Webhostbudd_well, all of the illumos stuff seems to be using pkgsrc [23:22]
up_the_ironsso illumos is only the kernel, and openindiana is kinda like kernel + userland (e.g. GNU) [23:22]
mercutiobut i think in general it's under quite a lot of active work [23:22]
up_the_ironsfreebsd jails can run cent? LOL [23:22]
Webhostbudd_up_the_irons: yea, i think that is probably more correct
up_the_irons: bottom line, you don't run illumos
[23:23]
up_the_ironsWebhostbudd_: yeah makes sense, at least roughly [23:23]
mercutioopenindiana has both sun and gnu userland [23:23]
Webhostbudd_directly
yea
[23:23]
mercutiols you have /usr/gnu/bin/dd
and /usr/bin/dd
and the normal dd doesn't support things like conv=fdatasync
[23:23]
Webhostbudd_there is a really cool fork out there
which im really digging
stormos
debian userland + illumos kernel
[23:23]
mercutiowebhost: what have they done? [23:24]
Webhostbudd_similar to debian kfreebsd [23:24]
mercutiooh? [23:24]
up_the_ironsi think i'm gonna load this up on one of my microcloud blades [23:24]
Webhostbudd_give it a shot [23:24]
mercutiosmartos is doiugn things new and fancy
like they want you to network boot
[23:24]
up_the_ironseven more reason to finish that box and haul it to the d/c [23:24]
Webhostbudd_mercutio: which is great [23:24]
mercutioand have all the storage on a machine running under zfs [23:24]
Webhostbudd_imagine how easy it is to deploy nodes [23:24]
mercutiowhich isn't a new concept [23:25]
Webhostbudd_nope
don't the big guys do it?
[23:25]
mercutiopeople have been doing such with esxi etc for a while [23:25]
Webhostbudd_vmware
yea
[23:25]
mercutiobut like they're working towards "well thought out" ways of doing things [23:25]
Webhostbudd_which i like [23:25]
mercutiobut also allowing a steeper learning curve
and doing things diffrently
like they're not trying to just support a whole lot of legacy ways of thinking
[23:25]
Webhostbudd_nope [23:25]
mercutiothey're trying to streamline things etc [23:26]
Webhostbudd_i really appreciate the effort for a solid, opensource hypervisor
linux really doesn't fit the bill
well, the distros of today don't
illumos is a very solid kernel though
hardware support is probably shaky though
outside of your common server hardware
[23:26]
mercutioit's better than esxi for hardware support [23:28]
up_the_ironsi would only want to run common server hardware ;) [23:28]
Webhostbudd_which is outstandingly sad [23:28]
up_the_ironsthe uncommon stuff is expensive... [23:28]
mercutioup_the_irons: one of the older hp's was broken a while back [23:28]
Webhostbudd_hp's make me cringe [23:28]
mercutiocpqarwy o rwhatever scsi controllers
cpqary3
[23:28]
up_the_ironsif it'll run on an Ivy Bridge 3.4GHz + plain ol' SATA + Intel GB, then that's all i need :) [23:29]
mercutiohttp://www.greenviolet.net/articles/2011/09/21/openindiana-151a-and-hp-smart-array-controllers.gv [23:29]
Webhostbudd_anyone here in the market for a sas expander? [23:29]
mercutioup_the_irons: yeh it'll do that [23:29]
up_the_ironsmercutio: yeah i didn't figure that basic of hardware would be a challenge [23:29]
mercutioup_the_irons: you need nehalem or whatever or newer cpus for kvm under illumos [23:29]
up_the_ironsmercutio: well sure, u need that for kvm in general [23:30]
Webhostbudd_yes [23:30]
mercutiowell the hp thing would effect quite a lot of older hardware
up_the_irons: nah
[23:30]
Webhostbudd_ehhhh
nah
[23:30]
up_the_ironswut [23:30]
mercutioup_the_irons: e5430 won't run kvm on illumos [23:30]
Webhostbudd_i run kvm on adm phenoms [23:30]
up_the_ironsmercutio: oh? why? [23:30]
mercutiobecause they're relying on some newer intel feature [23:30]
up_the_ironsah [23:30]
Webhostbudd_yes [23:30]
mercutiouhh it hikn it's EPT [23:30]
up_the_ironsinteresting [23:30]
mercutioi can't remember what it was [23:30]
Webhostbudd_that sounds correct [23:30]
up_the_ironsup_the_irons googles [23:30]
Webhostbudd_they don't support amd at all do they? [23:31]
up_the_ironsoh, extended page tables? [23:31]
mercutioweb: that was the case last i knew [23:31]
up_the_ironsno amd support?! [23:31]
Webhostbudd_nope [23:31]
mercutioup_the_irons: that's what it stands for but i don't know if that' the case
or if it was anothe rfeature
[23:31]
up_the_ironsk [23:31]
mercutioup_the_irons: someone may fix the amd stuff sometime
but smartos developers focused on intel
[23:31]
up_the_ironsi'm loving my AMD 6212 system... [23:31]
Webhostbudd_Currently KVM on OpenIndiana only supports recent Intel VT chipsets. [23:31]
up_the_ironsWebhostbudd_: ah gotcha [23:31]
Webhostbudd_bulldozer opterons huh? [23:32]
up_the_ironsyup [23:32]
Webhostbudd_do you get 16+ cores on those? [23:32]
up_the_ironsthe 6212's have 8 [23:32]
Webhostbudd_oh [23:32]
up_the_ironsbut two sockets on my board, so 16 altogether [23:32]
mercutioFinally, there is no support currently for AMD SVM. This is not a value judgement of AMD's technology, but rather a reflection of limited engineering and testing resources. (In the spirit of full disclosure, it should be said that the sponsor of illumos-kvm, Joyent, is an Intel-funded company -- but the lack of AMD support reflects only engineering prioritization and lack of testing infrastructure; AMD SVM support would be most welcome should someone in the [23:32]
Webhostbudd_it sucks that those 8 cores get beaten so badly by 4 intel cores [23:33]
up_the_ironsWebhostbudd_: my cpus: http://i.imgur.com/Ed6nw.png
Webhostbudd_: in benchmarks or real world operation?
[23:34]
Webhostbudd_actually more in real world [23:34]
up_the_ironscuz i'm finding them to be quite awesome [23:34]
Webhostbudd_but a lot of server stuff is multithreaded and integer intensive so bulldozer should be a good fit [23:35]
up_the_ironsyeah [23:35]
mercutioyou've also got context switches to worry about
and having more cores can cut down in that when virtualising
[23:35]
up_the_ironsexactly
context switching is super high in virt
[23:35]
mercutioi've never seen any good benchmarks for high load virtualisation
of multiple diff applications
[23:36]
Webhostbudd_no, and that is a problem [23:36]
up_the_ironsi find that benchmarks are like job interview questions; they look good on paper but do not reflect how the thing will behave in real life situations [23:36]
Webhostbudd_exactly [23:37]
mercutioup_the_irons: well it depends if you find the right benchmarks.. [23:37]
Webhostbudd_you can also find the right interview questions [23:37]
mercutiolike you cna easily find game benchmarks to know if a video card will be a good fit for you [23:37]
up_the_ironsmercutio: maybe i'm looking at the wrong stuff then [23:37]
mercutiobut finding cpu benchmarks for virtualisation ... yeh.. [23:37]
Webhostbudd_mercutio: that's pretty hard to say though [23:37]
up_the_ironsmercutio: yeah, games are specialized, cpus are generalized [23:37]
mercutiomm [23:38]
Webhostbudd_that's actually the problem with game benchmarks though [23:38]
mercutioi'd look at kernel compile time benchmarks probably [23:38]
Webhostbudd_unless you always play the same games... [23:38]
mercutiobut they're still not going to be accurate
webhost: you're comparing video cards to see what would be "good enoguh" for you :)
[23:38]
up_the_ironsmercutio: kernel compile time might be a good overall heuristic, it uses disk + cpu [23:38]
Webhostbudd_compile benchmarks have a lot of floating point though right? [23:38]
mercutiowebhost: nope [23:38]
up_the_ironsi would imagine
no?
[23:38]
mercutiowhy would compilers be floating point?
video encoding etc would be
but compiling is gnerally memory/integer heavy
[23:39]
Webhostbudd_see, i would assume that [23:39]
mercutioif you add 2.5 + 3.5 on a compiler using float point numbers
the compiler only has to generate the assembler
that doesn't require it actually doing the maths.
[23:39]
Webhostbudd_oh im not talking about that [23:40]
up_the_ironsmercutio: perhaps at the optimize phase there is fp (but not lexer, parser, etc...)
*optimization
[23:40]
Webhostbudd_yes
this is what i always thought
[23:40]
mercutiowell, if you multiply by 1.5
it probably does a shift
and adds it to the number
rather than actually doing it in floatin gpoint
[23:40]
Webhostbudd_im not talking about arthimetic in code at all [23:41]
mercutiohmm
there's not that much optimisation work these days.
there's some, but it's not really as fancy as people often seem to believe.
[23:41]
Webhostbudd_obviously
fancy stuff breaks
[23:41]
mercutioheh [23:41]
Webhostbudd_people like to believe a lot of cool stuff is at work [23:42]
mercutioit's mostly stuff like cache line optimisation that is easier for compiler to do than by hand [23:42]
Webhostbudd_mhmm [23:42]
mercutioand reordering to prevent stalls. [23:42]
Webhostbudd_yep [23:42]
mercutioi'm still surprised by how big the linux kernel is [23:43]
Webhostbudd_freaking massive [23:43]
mercutioi'd like a kernel < 1 megabyte compressed really
i have one with lots of stuff disabled and it's still 3.4mb compressed
back with linux 2.1 it wasl ike 500 or 600k compressed
[23:43]
Webhostbudd_lol freebsd kernel so small [23:44]
mercutiohow big is freebsd kernel? [23:44]
Webhostbudd_that's not real
bullshit
630k
really
[23:44]
mercutioopenbsd is 5.1 mb
did freebsd go to modules?
[23:44]
Webhostbudd_i do have a lot of stuff disabled in my kernel
freebsd does have modules
but i also removed a ton of built in device support
[23:44]
mercutioopenbsd isn't compressed
nor modular
[23:45]
Webhostbudd_well
my freebsd kernel doesn't even have ufs support
[23:45]
mercutiooh [23:45]
Webhostbudd_i mean, i compiled everything out [23:45]
mercutioit can't be zfs with that size
what fs are you using?
[23:45]
Webhostbudd_zfs doesn't build directly into the kernel
and zfs is only 120k
[23:45]
mercutiooh [23:45]
Webhostbudd_it's not huge [23:46]
mercutiothat's good [23:46]
up_the_ironsnice [23:46]
Webhostbudd_sec [23:46]
mercutioi've got this thing against bloat :) [23:46]
Webhostbudd_alright, i was massively mistaken
=p
2mb for zfs.ko
lol
[23:46]
mercutioheh
i thought zfs was big :)
it'll have support code etc
[23:47]
Webhostbudd_well, i knew it was big, i thought most people just overestimate [23:47]
mercutioheh
zfs is a bit of a memory hog too
it's nice ram got cheaper :)
[23:47]
Webhostbudd_oh god yea [23:48]
up_the_ironszfs is quite a memory hog [23:48]
Webhostbudd_zfs is fast with lots of ram though
blazing
i love that arc cache
[23:48]
mercutioweird this page says kvm just needs vmx [23:49]
Webhostbudd_which kvm? [23:49]
mercutioillumos [23:49]
Webhostbudd_linux kvm probably
oh
maybe they added support recently?
[23:49]
mercutioARC Size: Current Size: 3598 MB (arcsize) Target Size (Adaptive): 3598 MB (c) Min Size (Hard Limit): 638 MB (zfs_arc_min) Max Size (Hard Limit): 5111 MB (zfs_arc_max) [23:49]
Webhostbudd_and maybe that OI wiki is out of date [23:49]
jdoe"memory hog" is another word for "aggressive caching" ;) [23:49]
mercutiohttps://github.com/joyent/illumos-kvm/ [23:49]
***fink has quit IRC (Quit: fink) [23:50]
mercutioit goes real slow with 2gb of ram [23:50]
Webhostbudd_so wait.... that thing works on amd!
oh
[23:50]
mercutiowhat? [23:50]
Webhostbudd_derp [23:50]
mercutiosvm is amd [23:50]
Webhostbudd_yea [23:50]
mercutiothat page makes installing kvm really hard
it's actually simple on openindiana
[23:51]
Webhostbudd_just use smartos =p [23:51]
mercutioEPT is supported on E5430
maybe it does work on earlier cpus?
[23:51]
up_the_ironsinteresting [23:53]
mercutiowhat's this omnios [23:54]
Webhostbudd_people love illumos
jeese
[23:55]
up_the_ironsanyone know of a good iscsi target for linux? i see iscsitarget and open-iscsi (and i actually don't know of open-iscsi can be a target...) [23:58]
Webhostbudd_no idea
god, i can't believe illumos is built with gcc 3.4.3
that just feels super old now
[23:59]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)