up_the_irons do you rate limit icmp on your network? outbound only UDP is rate limited iirc oh, hah up_the_irons: ^ i liked the SP campaigns in mw + mw2 - mw3 bummed me out staticsafe: UDP over 5 Mbps on non-OpenVPN port is rate-limited no icmp limiting? ie, if i use smokeping on a bunch of hosts it wont be affected? stevenc: workin' fine for me No deviation from the ping times I get on other smokeing hosts ive got about 100 ips in mine and theres a bunch of jitter compared to other locations lovely, ARP's network just died v4 anyways looks alive to me... yeah, it's working here ferrovax.asininetech.com that doesn't ping on its v4 addr. v6 works.. indeed makes it to arp, then stops I get as far as 3: any2-ix.la.arpnetworks.com 57.561ms Also my ipv4 is down vps3.cobryce.com me too. can't get to ARP. it's been going up and down for about ten minutes. damnit up_the_irons fix your shit ^ jokingly - I'm sure he's on it, and it's not shit I blame the exchange <.< >.> I can get in from an oklahoma library I blame the exchange too toddf: got a traceroute from that .ok.us library? I'm coming from chunkhost who is directly on Any2IX it looks like, because my traceroute is 64.34.218.1 64.34.218.1 64.34.218.66 any2-ix.la.arpnetworks.com http://pastebin.ca/2454349 Looks like high CPU util on s1.lax I'm investigating Yep, different transit (toddf is coming in through mzim) (and hitting s7.lax) anything weird with overall net connectivity from 12:30 yesterday to 12:30 today? not just arp... but a bigger thing nothing I've noticed our queries per day cut in half for exactly 24 hours. brycec hit http://pastebin.ca/2454349 again, I have various points around the net all of which seem to come in the same way RandalSchwartz: there were some regional issues w/level3 and limelight networks, as well as west coast comcast connectivity issues sun/mon yeah, this just ended 2 hours ago we're in a brainstorming meeting to try to analyze huh, funky randalschwartz: analyze the internet or analyze how to keep the click rate up with network outages? analyze the outage/connectivity issues probably see if it was something we did to ourselves too and the answer of course is to make a nice donation to kickstart up_the_irons' fund for datacenter #2 I was asking a leading question so I could give the above answer, m0unds ;-) bahaha RandalSchwartz: presumably that's an easy question to answer: "Did anybody touch anything? Nope? Good!" just because I have an opinion doesn't mean I can't have fun with it :) is anyone else having network weirdness? On my network? Nope, 100% here. :P hazardous: but if you're asking about ARP... see above :p lol figures that's uhh.... like i have lost connetvity on some IPs fully in and out on ARP? Consider it a known issue. but i have one ip online still, i can ssh into that, then ssh from that into my others yeah it's all on arp hazardous: seems to be an issue with a transit provider/its router i'm more confused than anything that some are working and some aren't lol hazardous: check your traceroutes Anything going through 206.223.143.166 (Arp's any2ix router) seems to be dieing i idle in here right from my vps. no problem for me at the moment. ah 6 ge0-arpnet.cust.lax07.mzima.net (67.199.135.102) 53.246 ms 52.504 ms 52.744 ms that's last hop on broken ips orly? toddf had a working traceroute through mzima the stuff i still have online ends with 8 ge-0-7-0-24.r04.lsanca03.us.ce.gin.ntt.net (129.250.198.186) 9.476 ms 10.302 ms 9.825 ms 9 vl5.s1.lax.arpnetworks.com (208.79.88.129) 33.604 ms 33.869 ms 34.121 ms 14:15:36 <@up_the_irons> Looks like high CPU util on s1.lax 14:15:36 <@up_the_irons> I'm investigating odd that you're seeing opposite symptoms... Or maybe things are just balancing out yeah i dunno just tried from several systems from sf, oakland, and sj hitting mzima is going down, hitting that other one is connecting fine I've only tried from LA that being said, i'm unsure as to why .98 is mzima, .99 is mzima, .100 is ntt considering they're the same physical system from both ends (I didn't even notice, all my own traffic is IPv6 which is unaffected) haha mmkay I can confirm I'm not able to reach over timewarner/nlayer/mzima (I love that Timewarner routes my traffic through San Jose, instead of going straight through Seattle) he.net or whatever routed me once from sf to la via seattle > japan > hong kong > into la lol HE does silly things sometimes TW routes all my traffic through Denver. Makes no sense. (I'm way closer to Seattle, and it's not like there aren't links between Spokane and Seattle) what amuses me is that vl5.s1.lax.arpnetworks.com is a standard 10-15ms, but the last hop being my server up spikes to a consistent 250-300 (Then again, Washington/Spokane/Seattle are owned by Comcast) i don't know routing :V ahh, so I'm not the only one experiecing issues :) welcome to the party hah 8 any2-ix.la.arpnetworks.com (206.223.143.166) 48.691 ms 12.586 ms 12.562 ms My last hop before things die out and I'm back... me too me too CPU util coming down up_the_irons: s1 is a switch? _elf: yes, a Cisco 4500 ah; someone loop something, or spanning tree, multicast snooping, something else? something else. might have been a "log" keyword on an ACL. However, that ACL has been in place since the beginning of time, and hasn't caused an issue.. but i removed it for good measure CPU util came down I then put it back and CPU util was still good so perhaps coincidence not really clear funny I'm going to keep the "log" ACL off for now sh proc cpu | e 0\.00 but I am guessing you know about that i generally do "sh proc cpu s 5m" ah thanks though, i *didn't* know about that :) np i hope this doesn't jinx anything, but i'm quite proud of this: "s1.lax uptime is 4 years, 30 weeks, 3 days, 2 hours, 25 minutes" haha Nice. you have this one beat by a bit: cs3.511 uptime is 4 years, 9 weeks, 6 days, 13 hours, 32 minutes _elf: hah cool _elf: what make/model switch is cs3.511 ? Cisco 3560G-24TS; sort of sits in the middle between some border routers and aggregation (along with another) _elf: ah cool Anyone here familiar with basic javascript document.write functionality? I cant seem to find the right resource for including content from another site into my page