jdoe: up_the_irons: whichever one my vps is on... sec, lemme dig up my portal info so I can see where I am :P
huh... ipv6 48/64 thing... that's new, could have sworn my /48 was routed before.
up_the_irons: kvr06, about the time I pasted that.
(ditto for yesterday) up_the_irons: jdoe: roger that. hrm, kvr06 is a host i haven't touched in a while jdoe: yeah, you mentioned that, nobody ever quits.
it's weird. I was frustrated with IO a few weeks ago, so I cron'd that dd+sync to run every 5 minutes and log stats. Problem disappeared. It's only when I'm not waiting for it that I get poor throughput. up_the_irons: lol "nobody ever quits"
another order from an IPv6 address
from GB
it's taking off... mercutio: up_the_irons: yeh that was beta vm
up_the_irons: when you've got some time i'd like my I/O changed to virtio, and if that doesn't work scsi.
err probably even if it does work, cos it's probably pointful testing it up_the_irons: mercutio: done, give it a hard reboot. i change disk and NIC to virtio. mercutio: cool
you can't force a hard reboot can you
chrome for some reason doesn't want to let me click on login
i'm confused
err the web page became unresponsive
oh dislabing threaded compisitin gfixed chrome up_the_irons: mercutio: i can hard reboot if u want mercutio: it's booting now
it looks good so far
but just kernel bit
oh
i should have shutdown inside the vm properly :/
it's fscking
but good sign
it has vic0 now
isntead of em0
i'm making symlink and rebooting
btw is it possible to have more cpu flags passed to the vm?
cos there's something that improves ssh isn't there?
hmm it's about 8mb/sec for dd now
as long as it doesn't stall i don't care too much
(it was about that on the other vps)
and network works too
network speed is similar up_the_irons: mercutio: so you have both disk and nic working with virtio?
mercutio: about cpu flags, i don't know of anything specific that makes ssh faster mercutio: yip
41 seconds to extract baes52.tgz
i thought there was aesni or osmething up_the_irons: wow nice, good job. was the procedure hard? i don't even think toddf has it working yet (but i might be wrong) mercutio: at the moment it's the default qemu base cpu thing
umm well i'm using recent snapshot
which is why i thought i should test scsi
cos it seems that 5.2 won't have the virtio stuff
going to compare against the old vm now
oh it also changes from wd0 to sd0
it's using uuid type stuff by default though so you don't have to do anything
tar vxzpf /root/64bit-base52.tgz 1.89s user 20.59s system 65% cpu 34.232 total
it's faster on the old system
but less cpu% on the new system ***: jnq has joined #arpnetworks mercutio: looks like it's slower for writes
maybe it's doing sync versus async
both file systems have noatime,softdep up_the_irons: mercutio: the new system has a really busy cacti VM on it that i should actually migrate somewhere else so we get a better picture of the performance mercutio: hmm
there's not constant disk load though is there?
err constant high
iostat -x should tell you what it's like up_the_irons: no, it's not constant, but like every 5 minutes, there a load burst mercutio: yeh
i'm turning on VIRTIO_DEBUG
i think it tells buffer sizes etc up_the_irons: my kvr26 host
$ iostat -x
Linux 2.6.28-19-server (kvr26) 10/11/2012 _x86_64_ (8 CPU)
avg-cpu: %user %nice %system %iowait %steal %idle
13.70 0.00 10.84 0.79 0.00 75.01
so less than 1% iowait
but on kvr27 (new box)
avg-cpu: %user %nice %system %iowait %steal %idle
5.24 0.00 2.86 12.15 0.00 79.75
so > 12% mercutio: oh :) up_the_irons: quite busy mercutio: what's kvr15 like?
cos that's what i'm testing against up_the_irons: kvr15:
avg-cpu: %user %nice %system %iowait %steal %idle
8.29 0.00 7.07 0.80 0.00 84.29 mercutio: allocated 45056 byte for virtqueue 0 for I/O request, size 128
using 36864 byte (2304 entries) indirect descriptors
vioblk_attach: ; qsize: 128 seg_max: 18
ahh so similar to kvr26
actually less load than kvr26 up_the_irons: so if you're finding the i/o the same speed as the old server (but on virtio), then that's actually not bad since kvr27 has 12x the IO load on it already mercutio: your iostat -x doesn't show msec
it shows averages
weird
Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz await r_await w_await svctm %util
sda 0.06 0.23 0.76 19.35 7.91 97.64 10.50 0.01 0.66 0.63 0.66 0.05 0.11
oh
its' below it?
that's what i find more useful
that is just my router so super low load
err my router is on sdd too
ssd up_the_irons: mercutio: that cuz on my end it shows every individual VM disk as "dm-XX' and I don't wanna paste all that ;) mercutio: oh
what about the md1?
or whatever that lvm is on top of up_the_irons: ah ok, here:
sdb1 28.20 215.77 9.82 38.22 316.84 2032.17 48.89 0.10 2.02 1.09 5.22 mercutio: yip that's high up_the_irons: that's 15 mercutio: wow
see how much higher write load is than read load
actually it's not that high up_the_irons: here's kvr27:
sdb 2.09 298.10 2.29 177.67 296.07 3836.57 22.96 5.75 31.96 1.71 30.74 mercutio: you have two less fields than me
iostat added too fields up_the_irons: lol mercutio: in some ubuntu version up_the_irons: here are the headings:
Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s avgrq-sz avgqu-sz await svctm %util mercutio: and ubuntu takes packages freom debian
ahh
so it's just plain average wait
not split by read/write up_the_irons: looks like the await was split into read/write mercutio: it has all 3 :) up_the_irons: :) mercutio: well having high write average time doesnt' matter too much
compared to read
welll "it depends"
yeah
so according to that there's an average delay of nearly 32 msec on kvr27
and just over 2 msec on kvr15
each request takes about 10 msec ***: Ehtyar has joined #arpnetworks mercutio: so it's like queueing behind 3 other requests
mm up_the_irons: i c mercutio: i'll try extracting that tarball again
see how the numbers compare..
wow
tar vxzpf /root/base52.tgz 2.74s user 6.53s system 42% cpu 21.820 total up_the_irons: munin-graph is currently running and being a usual hog mercutio: heh
but i got half the time taken as last time up_the_irons: nice :) mercutio: i have turned on VIRTIO_DEBUG...
and rebooted
so it shouldn't be cached
and may go slower if aynthing
so yeh benchmarking could be hindered by other activity up_the_irons: yeah mercutio: my testzero write is going slow still
104857600 bytes transferred in 36.133 secs (2901970 bytes/sec)
that's 100mb
it's actually slower than last time
so yeh it's prob bouncing up and down a bit
actually where it says 177.67 on that iostat...
that's quite a lot of writes/sec
i suppose it's making a write per graph made
but that's basically the kind of work load where raid 5 will go faster than raid 10
err it could be
it depends how much seeking involved
mm, it also doesn't seem to be write stalling
ie - you can ssh in while it's busy doing stuff
aesni is in bulldozer cpus
it mostly speeds up ssh and vpns
and supported since openbsd 4.9
and in recent linux openssl
err recent linux kernel, and recent openssl
i can't remember how recent, but probably within the last year
<feature name='aes'/>
in qemu apparently
apparently they don't pass all cpu features through so that you can live migrate to a cpu that doesn't ahve those features up_the_irons: yeah mercutio: it may make scp faster up_the_irons: i don't see aes in my "virsh capabilities" mercutio: but it probably mostly just reduces cpu usage up_the_irons: boo mercutio: oh you're using virsh
can virsh pass through the cpu?
err host cpu up_the_irons: i don't believe you can set arbitrary qemu command line params until a later version mercutio: '-cpu host' is not something that we intend to support in libvirt, because it is an opaque blob whose semantics cannot be determined, queried, analysed. Furthermore it is completely redundant given the capabilities already present in the libvirt CPU description framework. up_the_irons: libvirt development is fast, so i'll need yet another upgrade before i get some of the newer features mercutio: hmm
You can get the equivalent of -cpu host by running 'virsh capabilities' (or the API) to query the current host <cpu> description, and then copying that <cpu> unchanged into the guest XML. At most we could add a syntactic sugar at the XML input stage where <cpu><model>host</model></cpu> gets automatically expanded into the full <cpu> XML from the capabilities.
on dom0 cat /proc/cpuinfo | grep -i aes
shows aes right? up_the_irons: you mean "grep -i aes /proc/cpuinfo" ;)
and yeah, it has aes
brb mercutio: yeah same diff
http://wiki.libvirt.org/page/Libvirt_identifies_host_processor_as_a_different_model_from_the_hardware_documentation
this says libvirt can sometimes see cpu as lower model than it is and lose features, in two cases aes ***: Webhostbudd has quit IRC (Quit: Leaving)
lazard has quit IRC (Ping timeout: 256 seconds) up_the_irons: boo ***: lazard has joined #arpnetworks up_the_irons: lol http://i.imgur.com/LZ73H.png easymac: heh
Been meaning to mess with clang/llvm, but I'm lazy and have no real demand for C code right now. up_the_irons: C was first language I learned after BASIC; it always holds a place in my heart even though I never have a chance to use it anymore easymac: heh It was my first language.
I love C, but I never really have demand for it doing network/infrastructure stuff. It's usually easier/faster to script something. ***: Ehtyar has quit IRC (Quit: +++ OK ATH OK) up_the_irons: yeah for sure mike-burns: C was my first language, too, and I've never actually used it. Better than asm, though. easymac: Sorry we can't all be using your hippy fad languages, mike-burns. heh -: CaZe is idling in ##c easymac: I find that the more help channels I idle in the more discouraged I am with help channels. dzup: i dont help, dont talk, just idle, am a irc bloodsucker leech easymac: I help in one of them, the rest are just a waste. mike-burns: I give bad advice in #haskell. easymac: Just for fun? mike-burns: Yes, and also because I don't know better.
Just like how I give bad directions on the street: it's fun, and I can't give good directions anyway. ***: gcw|mbpro has quit IRC (Remote host closed the connection)
heavysixer has quit IRC (Remote host closed the connection)
rootpwned has quit IRC (Ping timeout: 246 seconds) easymac: haha
fair enough ***: rootpwned has joined #arpnetworks
rootpwned has quit IRC (Quit: rootpwned)
chmod has joined #arpnetworks DDevine: Ah thanks for including my username in the "your debit card is expiring" email. I log in so rarely that I completely forgot.
179 days uptime apparently. phlux: [phlux@bryant ~]$ uptime
8:32AM up 446 days, 12:40, 3 users, load averages: 0.02, 0.01, 0.00
my arp uptime :P ***: toddf has quit IRC (Remote host closed the connection)
nukefree has quit IRC (Ping timeout: 246 seconds)
toddf has joined #arpnetworks
ChanServ sets mode: +o toddf
kraigu has quit IRC (Read error: Connection reset by peer)
kraigu has joined #arpnetworks
nukefree has joined #arpnetworks
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
HighJinx has quit IRC (Quit: Computer has gone to sleep.) toddf: heh
I guess I don't have to worry a ton about bandwidth when my _yearly_ bandwidth is 1/5 my monthly allowance ;-) ***: HighJinx has joined #arpnetworks milki: o.O ***: chmod has quit IRC (Ping timeout: 246 seconds)
chmod2 has joined #arpnetworks mercutio: heh
toddf up_the_irons was saying that you couldn't get virtio to go on openbsd? toddf: mercutio: not on 'current production' he has, but there is a beta system that boots openbsd just fine mercutio: todd: oh right toddf: caveat is virtio is not on the install media
so you have to install first, then reboot, and never need a bsd.rd
or just wait until someone fixes the install media mercutio: mm
was that with 5.2 or snapshot? toddf: the current production systems lack a bios hook to show the virtio disk as a disk, therefore the bootloader can't see the disk mercutio: oh 5.2 isn't out yet is it? toddf: current only has virtio, beyond 5.2 mercutio: yeh
i have snpashot working on the beta system
with snapshot
but the host has to be set to virtio :(
with xen it's just automatic toddf: so in theory you could email support@arpnetworks.com and give the uuid of your beta vps and you too can have virtio mercutio: i have virtio :) toddf: be aware mv /etc/hostname.em0 /etc/hostname.vio0
well you can use virtio mercutio: i symlinked it
so now i should be able to boot with either toddf: if it works mercutio: yeh it works
performance was slightly better
not amazing though toddf: performance is already amazing mercutio: dunno if you did many tests?
i got 8 mb/sec on dd? toddf: I'm moving my colo this week, will do more thorough testing next week mercutio: but on the new system without virtio there were these weird i/o stalls
and virtio seemed to fix that
apparently there are some disk heavy things on there too though
i suspect it's about read ahead or such
although i'd think dd with bs=1024k would fix that jdoe: 8MB/s is not amazing :P toddf: the linear read is not as impressive as seek times which takes more than a simple dd to measure
I had a system at the prompt because fsck wanted attention mercutio: yeh toddf: I typed 'fsck -y' and about 5 seconds later it was done due to fast seeks mercutio: write was actually faster
hmm
it's also had "bad" it gets
like if you get high i/o latency it can be way less than 8mb/sec
on a normal system phlux: i have some serious permissions issues on my freebsd vps, and i can't think of a way to fix it without just starting over milki: o.O
did you do a recursive chmod from /
ive done that before... phlux: no
but for some reason, web servers can't reach anyone's files without setting them 755 or similar
it doesn't end there, either milki: sounds like the web server's fault phlux: unless i'm doing something as root, i get permission denied for several things
the web server is just the most prevalent milki: got a transcript? phlux: yeah i was thinking that, too, but i don't understand how
i've tried two different servers (apache and nginx)
neither can get proper access milki: you verified the user the server process runs as? phlux: hmm
that may be an issue
nginx:nginx (user:group)..the group doesn't exist in /etc/group milki: :o
i ownder how that happened phlux: i figured that would've been taken care of during the installation -: milki too phlux: i wonder how it's even running milki: lol
maybe it defaulted to the nobody group -: phlux shrugs phlux: i'll see if this handles it then heh mercutio: oh, my initial thought about the 8mb/sec virtio seems to be wrong
rer, or limited, openbsd goes slow if you don't use the raw device, and dd straight from the hard-disk
but if you dd frmo a file on a mounted file system, or the raw device it's fast
use ps auxw?
to check what it's running as
usually on linux files use :www-data
with read permissions
and you own the files by the user hosting the web conent
which has read write
you don't really want your web server being able to write to hosted files normally
as it means if you get any kind of exploit of the web server that people can "hack" your site milki: perhaps, but that depends on the server setup
its very explicit in the configuration mercutio: yeh sometimes people su to the user that owns the files for php i think easymac: 1/
oops up_the_irons: DDevine: yeah, the username in that email was requested a few times with people who have several separate accounts
phlux: i remember there is a prog on freebsd to fix all permissions from / and downward, but i don't remember the name... ***: wallshot has joined #arpnetworks wallshot: what did i miss? did i trip over the internet power cable and unplug it again? -: wallshot wins @ tripping over cables ***: Ehtyar has joined #arpnetworks
cmeiklejohn has joined #arpnetworks
nixbag has joined #arpnetworks
gcw|mbpro has joined #arpnetworks
gcw|mbpro has quit IRC (Remote host closed the connection)
gcw|mbpro has joined #arpnetworks jbergstroem: not perhaps very relevant to arpnetwroks (but we do discuss virtualisation every now and then), but here's a pretty good primer from hendrik volkmer on smartos: http://blog.hendrikvolkmer.de/2012/09/07/why-smartos-as-an-openstack-base-os/ wallshot: that's neat, thanks ***: cmeiklejohn has quit IRC (Quit: ["Textual IRC Client: www.textualapp.com"])
wallshot has quit IRC (Remote host closed the connection) qbit: up_the_irons: did you get that redis majobber going? phlux: up_the_irons: are you talking about mtree? ***: HighJinx has quit IRC (Quit: Computer has gone to sleep.)
gcw|mbpro has quit IRC (Remote host closed the connection)
gcw|mbpro has joined #arpnetworks
warex has joined #arpnetworks warex: I'm a new customer. I've selected OpenBSD 5.1 but there is no xbase and x* installed. I remember that in OpenBSD it can just be updated, rebooting from the cd-rom. Is there a way to do it on my virtual computer? mhoran: You can request to have the CD installed for you. Just send a support request. up_the_irons: qbit: negative
phlux: mtree?
warex: yeah, here are the instructions to boot from the CD-ROM: http://support.arpnetworks.com/kb/vps/custom-partitions phlux: 17:46:15 @up_the_iron+│ phlux: i remember there is a prog on freebsd to fix all permissions from
│ / and downward, but i don't remember the name...
sounds like you're talking about mtree warex: got it thanks! milki: oo, i didnt know you could use mtree like that up_the_irons: phlux: oh! ok, yeah maybe it was that
warex: np! mercutio: warex: you don't need to boot off cd to install xbase
you can basically download xbase51.tgz then cd / && tar vxzpf /location/xbase51.tgz
you shouldn't need all of X if things if it's just things like the font thing
font library that gd and stuff need ***: gcw|mbpro has quit IRC (Ping timeout: 255 seconds)
gcw|mbpro has joined #arpnetworks
HighJinx has joined #arpnetworks
gcw|mini1 has joined #arpnetworks
mjp has quit IRC (Quit: leaving)
gcw|mbpro has quit IRC (Ping timeout: 248 seconds)
mjp has joined #arpnetworks
andol has quit IRC (Quit: leaving)
andol has joined #arpnetworks dzup: f i clic in a http://ipv6:ip:adress enable webserver should work right? reardencode: I believe it needs to be http://[ipv6:ip:address]/ dzup: i had try http://2001:5c0:1000:b::c7b1/ no luck, can you see me? toddf: try with brackets dzup: cuz if i try to telnet me ipv6 80 i get apache response
but no over my bwoser, send me to the google search deal ***: Sapote has joined #arpnetworks
Sapote has left
gcw|mini1 has quit IRC (Remote host closed the connection)
gcw|mbpro has joined #arpnetworks
warex has quit IRC (Quit: Page closed)
gcw|mini1 has joined #arpnetworks
gcw|mbpro has quit IRC (Ping timeout: 240 seconds)