***: m0unds_ has joined #arpnetworks
RandalSchwartz has quit IRC (Ping timeout: 256 seconds) mercutio: woot, got a 10x improvement in guest to host network performance ***: qbit has quit IRC (Ping timeout: 272 seconds)
qbit has joined #arpnetworks
qbit is now known as Guest5445 mercutio: http://man7.org/linux/man-pages/man7/lvmcache.7.html
has anyone seen this before? ***: Guest5445 is now known as qbit mercutio: acf_: i am trying to access your smokeping. did you disable it for external access?
hmmm..
also your / exposes more than it should, but loads. ***: medum has quit IRC (Ping timeout: 264 seconds)
medum has joined #arpnetworks m0unds: seems there's some congestion tonight mercutio: yeh
on level3
can you do a mtr? m0unds: yea, it's the return path mercutio: i'm trying to track it down, but i reckon it's level3 m0unds: it is mercutio: it's really bad to my uk server. m0unds: it's ugly
haha
i'm seeing 60ms +/- 150 mercutio: oh i just saw loss, and throughput issues
udp loss was higher than icmp loss
but latency seemed normal
but throughput seemed even worse than the udp loss
i just got a vultr vm that's on level3
there's only one location in the US that routes via level3 from arp, most are ntt m0unds: yeah, udp loss is gross mercutio: what's your ip? m0unds: like 50+%
arp IP? mercutio: oh wow i didn't see it that bad before
nah ip you're coming from m0unds: 73.26.90.138
http://pastebin.com/HUZS2VD0 mercutio: yeah it loosk strange m0unds: not as bad that run mercutio: it's up and down a lot m0unds: yeah mercutio: that's with -u? m0unds: yeah
on the bottom, forgot to redo the top mercutio: yeah do icmp
it's bloody hard to read with all that hop alternating
it seems you're not getting loss just latency from that though
and from my mtr from arp to you it's the same
it actually looks like comcast issue in this instance :/ m0unds: looked largely the same mercutio: yeah just trying to track down wehre it's happening
try doing 500 of them
i realise it takes nearly 10 minutes :)
but if there's a couple of percent loss or something it shows it up better m0unds: well, there's nearly always loss at any time of the day on level3 w/icmp mercutio: yeah on those earlier hops m0unds: that's been my experience w/them forever mercutio: it's whether it carries through m0unds: i don't tend to have any loss at the destination, just along the path mercutio: but ssh is laggy? m0unds: but when i mentioned congestion, i saw a lot of loss. it seems to just be high latency now with no loss
it isn't BryceBot: That's what she said!! m0unds: BryceBot: no BryceBot: Oh, okay... I'm sorry. 'it isn't' mercutio: i'm getting good speeds from this level3 connecting vultr vm :(
ahh ok
ssh wasn't laggy it seemed to uk for my "cl" program
but i was getting really bad throughput
starting around 6 hours ago
i updated my kernels and got some speed boost in general
http://uk.meh.net.nz/cgi-bin/smokeping.cgi?target=Curl.chi
i should fix the naming
that's la.meh.net.nz
http://uk.meh.net.nz/cgi-bin/smokeping.cgi?target=meh.lameh
but ping has been ok
and loss isn't that high m0unds: http://pastebin.com/BNiUsqcP mercutio: comcast's routing is changing a lot grr :/
what throughput do you get atm?
it seems it's going via los angeles or denver m0unds: yea, it changes depending on time of day
sometimes it's direct abq > lax mercutio: it changes within the trace m0unds: sometimes it's denver > lax mercutio: but that may be the jitter m0unds: route change adds 10ms to ping but that's it
throughput is nearly always the same mercutio: and it's still ok? m0unds: yep mercutio: hmm damnit
so that's different to the other issue :/ m0unds: actually nope
it just tanked
was going 1.2MB/sec, dropped to 400KB/sec
that's pretty slow both times mercutio: yeah that's more like wha ti been seeing
except lower because it's from uk m0unds: well, here mercutio: higher ping makes loss worse m0unds: http://pastebin.com/3HhgkHDa
two local hops from arp > comcast are gross mercutio: http://pastebin.com/9FhM7qHX m0unds: yeah, that same 150-200ms "worst" measure is in the same spot as mine
5 & 6 mercutio: yaeh hard to know if that's deprirotisiation or not
the latency to hop 5 for me is going hmm
bi'm still running my download heh
average speed 49305 bytes, current speed 45476
it was going 80k/sec before
anyway why's it fine with this vultr vm grr
by fine i mean 7.6mb/sec
oh shit m0unds: ? mercutio: it's coming in from vultr via nlayer
i wonder if that has any bearing
oh and now it's showing loss on last hop
and on mzima pings heh m0unds: did you stop your dl? mercutio: nope
dl slowded down
its' getting slower nad slower m0unds: funky mercutio: 27k/sec now m0unds: wow mercutio: yeah i know it's weirdly slow
and how does 6% icmp loss fit in with that?
with 7.6mb/sec
damnit i have to wait for dns ttl :(
this is making no sense
so there's packet loss from la to miami
but throughput is good
and the packet loss starts at gtt in san jose
and throughput is good in both directions
maye it's bursty
heh " curl -q http://weallsee.net/testspeed | sh
"
is convenient
but it feels dirty just running stuff downloaded off the internet
it could be anyhting
m0unds: i'm setting high jitter to you from jp.meh.net.nz over ntt too
so it may be your path to arp
or within comcast's netowrk m0unds: i'm loading my connection up quite a bit
atm mercutio: ahh ok
maybe that's it then
i'm trying to get my systems better organised for pushing smokeping etc :) mnathani_: mercutio: what os are most of your vultr vps? mercutio: ubuntu
one is arch
if there was arch auto provisioning they'd all be arch
i've just shifted them all to custom kernel though mnathani_: any performance benefits? mercutio: a little
to the kernel
i'm not sure why :)
i did the kernel when i was trying to debug guest-host kvm performance at home
Startup finished in 944ms (kernel) + 491ms (userspace) = 1.435s
that's sj
Startup finished in 948ms (kernel) + 732ms (userspace) = 1.681s
and that's my home vm
home vm is ubuntu
and tcp performance went up a little acf_: mercutio: hmm, haven't touched the smokeping config
probably just congestion or something
huh. it's acting funny for me too
[....] Starting latency logger daemon: smokeping
>:(
all of the smokeping things are blocking on something
huh. that was really weird
seems that smokeping was blocking on DNS resolution
both the CGI and the service mercutio: damn
i wonder why
oh it didnt' seem to lose data?
cool 4.2.2.1 is screwed
from about 2pm your time
aare you pdt?
hmm and phoenix.acfsys.net
is that a box you can trace from?
oh it's a tunnel or something