[01:03] yeah i know but there are politics involved... [01:04] if it's not tweaking every little site but only the bigger providers then it's simpler config wise [01:04] and if it's that the as path length is the same for both, it could hop randomly if the weight is the same [05:18] *** jcv has quit IRC (Quit: leaving) [05:31] *** jcv has joined #arpnetworks [05:33] *** jcv has quit IRC (Client Quit) [05:33] *** jcv has joined #arpnetworks [05:38] *** ziyourenxiang has joined #arpnetworks [06:10] *** jcv has quit IRC (Quit: leaving) [06:11] *** jcv has joined #arpnetworks [06:23] *** ziyourenxiang has quit IRC (Quit: ziyourenxiang) [06:25] up_the_irons: 14.04 here, but mine are in enforce mode [08:16] *** novae has quit IRC (Ping timeout: 245 seconds) [08:20] *** novae has joined #arpnetworks [08:20] *** novae has quit IRC (Changing host) [08:20] *** novae has joined #arpnetworks [10:22] up_the_irons: fwiw, I emailed the NTT NOC a long time ago [10:23] idk if you've seen it [10:23] http://paste.unixcube.org/k/bb55b1 [10:33] ... http://dogeon.org/ [11:54] *** Amfy has joined #arpnetworks [11:55] *** Mifta has joined #arpnetworks [12:00] *** Mifta has left [12:07] *** toddf has quit IRC (Ping timeout: 252 seconds) [12:16] *** toddf has joined #arpnetworks [12:16] *** ChanServ sets mode: +o toddf [12:46] it seems that the return path of level3 (level3 -> arp) goes through gblx and trit [12:46] http://paste.unixcube.org/k/e0c7ac [12:48] mercutio: I would think that since ARP and level3 are peered that it wouldn't go through trit [12:51] acf_: i've seen people mention that it's only outbound l3 right now [12:52] http://pastebin.com/k3meCyuJ acf_ - from a couple days ago [12:52] *** novae has quit IRC (Ping timeout: 245 seconds) [12:53] cool, thanks, didn't see that [12:54] sure thing, had to dig through my buffer to find it. wondered if i'd just imagined seeing it :) [12:55] *** novae has joined #arpnetworks [13:06] I too recall up_the_irons stating it's outbound only now, that ARP isn't yet announcing. [13:06] A nice gradual turn-up [13:13] http://urbanvivant.com/wp-content/uploads/2010/12/turnip.jpg [13:14] yay. my headphone amp was repaired and is on its way back to me. [13:14] onboard audio makes me sad [13:24] *** httpduck1 has joined #arpnetworks [13:26] *** httpducks has quit IRC (Write error: Broken pipe) [15:06] m0unds: turns out i had the security driver set to "none" in the config; so commenting that out fixed the prob [15:07] acf_: i haven't announced our routes to level3 yet [15:07] it's all outbound [15:08] oh, all you guys already said outbound... [15:08] * up_the_irons needs to read more scrollback before responding [15:09] :) [15:10] acf_: read your email; so i take it Verizon didn't respond when you contacted them? [15:16] up_the_irons: ah, gotcha [15:16] up_the_irons: noticed any difference in CPU load on the updated hosts? [15:17] slightly lower [16:23] I was working to counter that last night with a git-gc on a 1.5GB repo... Then again, i'm not on an updated host yet [16:37] haha [16:39] up_the_irons: yep. basically Verizon won't talk to you unless you're a transit customer or something [16:39] that's been my experience with them anyway [16:39] aholes [16:40] yeah [16:40] I don't think they could/would have told me any more than NTT anyway though [16:42] up_the_irons: how do the as path lengths compare with verizon/comcast/etc? [16:43] mercutio: as path lengths of what? [16:43] i do wonder if a lot are the samw [16:43] verizon ip's [16:43] umm [16:43] whatrever acf is tracing to [16:43] comcast.net is a good comcast example apparently [16:43] i can't remember acf's traceroute site :) [16:44] http://kremvax.acfsys.net/smokeping.cgi?target=Remote.verizon-lsanca [16:44] that's a router [16:44] verizon.net [16:45] you shouldn't really make assumptions about routers cos of deprioritisation etc [16:45] verizon.net actually takes a different return path [16:45] hmm [16:45] if you look at the last 360 days graph [16:45] but yeah i do wonder if as path length is the same [16:46] hmm i have some verizon ip i'm smokepinging from nz [16:46] * acf_ goes to plug in DSL modem [16:48] hmm there's loss atm [16:48] there's always loss [16:48] from arp [16:48] but not from nz [16:48] yep [16:48] oh [16:48] yeah from nz it's going via alter.net [16:48] which is verizon right? [16:48] yep [16:49] what is going via alter.net? [17:08] from my home [17:08] oh sweet kvr15 update is happening :) [17:09] i wonder whose ip this was [17:09] ae-0.verizonbusiness.lsanca03.us.bb.gin.ntt.net [17:09] the packet loss seems to start there [17:13] same from arp [17:15] this is from arp [17:15] from home there's no loss :) [17:15] ah, ok [17:39] *** grepidemic has quit IRC (Read error: Connection reset by peer) [17:40] *** mus1cb0x has joined #arpnetworks [17:40] how can i find out if my vps has acpi enabled? [17:40] i think they all do [17:40] unless it's dos or something [17:40] what OS? [17:41] fbsd 9.2 [17:41] in openbsd it shows up in dmesg [17:41] yeh that should be fine [17:42] did you get emailed too? :) [17:42] yeh [17:42] i guess we're server brothers [17:42] heh [17:42] LOL [17:42] he did say he was doing two servers [17:43] i'm on 14 [17:43] i'm actually doing three now [17:43] im'm on 15 [17:43] oh [17:43] i have some extra time next week, so might as well bust out the upgrades [17:43] up_the_irons: is it getting easier? [17:43] 14 > 15 [17:43] neighbors then [17:43] mercutio: it IS actually.. last few upgrades have went very smoothly, even faster than my estimated time in the maint advisory [17:43] *** grepidemic has joined #arpnetworks [17:44] i always overestimate times myself [17:44] just in case anything goes wrong [17:44] and because i usually underestimate by default [17:44] yeah [17:44] we can't use virtio until there's a knob though right? [17:45] well without manual support request [17:45] you can modify the host OS without it affecting the disk partitions of the vpss? [17:47] mus1cb0x: that's normal for virtualisation hosts. [17:47] the two are disconnected [17:48] i wonder how deep you can nest that before things go weird [17:48] imaging a tight loop programmatically creating nested guest environments [17:48] some will run openvz inside kvm [17:48] qemu [17:48] ad infinitium i imagine [17:48] you could send a chinese hacker into a mirrorverse of insanity [17:49] you'd probably run out of memory though [17:49] the extra hw abstraction can help you work around bad hw support in kernels compatible w/openvz [17:49] qemu doesn't need privileges for emulation [17:50] it also supports non intel cpus [17:50] yes, i run qemu on an opteron server [17:50] probably quite slowly. [17:50] m0unds: no, i mean like it can run on powerpc etc [17:50] and can emulate 68k etc [17:50] oh, non x86 [17:51] xen is using qemu too [17:51] but qemu is actually supporeting lots of weird stuff, it's damn cool in a way [17:51] not a big fan of xen-pv [17:52] bhyve is getting some nice upgrades this summer [17:52] xen has a whole lot of new modes now [17:52] like hybrid stuff [17:52] modern cpus are not so quick in pv mode [17:52] yeah, but lots of hosts that run xen environments won't run w/hvm or whatever [17:52] yeah there's somethign in between too [17:52] so you're stuck with linux or obnoxiously unstable bsd [17:52] which is better [17:53] well yeh i chose arp becauase of kvm and openbsd [17:53] err [17:53] kvm and ipv6 [17:53] yep [17:53] because i wanted to run openbsd [17:53] by openbsd i assume you mean freebsd [17:53] right [17:53] i don't use ipv6 though [17:53] ;> [17:53] oh location was theo ther reason [17:54] haha [17:54] i'm in new zealand, los angeles and san jose are the only two fsat places from here really [17:54] i have a silly amount of unused referral credit w/another provider that i won't use until i can get bsd stable in their env [17:54] well low latency [17:54] i've run freebsd on xen fwiw [17:55] it runs fine in hvm [17:55] and openbsd on vmware [17:55] it runs in pv mode too [17:55] it's terrible in xen-pv when your only option is pvgrub to bootstrap bsd [17:55] it's awful [17:55] but it runs better in hvm mode [17:55] i was using pygrub i think? [17:55] it was on opensolaris [17:56] which doesn't have pvgrub , and is xen 3.4 [17:57] oh having it's own cp is good too [17:57] i am kind of anti solusvm [17:57] yeah, solusvm is awful [17:57] the way it handles assigning ipv6 addresses is hilarious [17:58] you don't get a routable /64 or whatever, you get X number of addresses [17:58] so...8 or 16 [17:58] or whatever the host chooses [17:59] mercutio: i'd like to visit nz some day [18:00] m0unds: sounds very mcdonalds [18:01] mus1cb0x: heh [18:01] m0unds: it's also got lots of funky mysql and iptables stuff [18:02] if you want to do thigns like limit people to their own ip it's complicated by solusvm getting in the way with iptables [18:02] which means most solusvm hosts allow spoofing [18:03] most are just huge bridge domains too [18:03] so you get arps for a whole lot of random ip's [18:09] Comcast cable kind of does the same thing [18:09] you see lots of arps for random IPs [18:09] can you spoof? [18:10] i think that's just the nature of cable networks [18:10] no [18:10] no [18:10] how many /24s is it? [18:10] well, my netmask is /24 [18:10] cable network in nz overloaded [18:10] and if I try to ping things in the same /24 [18:10] and routers couldn't handle the number of arp requests [18:10] there was no standard router provided [18:11] the cable network gateway will spoof its mac address for the ARP replies [18:11] but it meant lots of people's internet died completely in evening [18:11] yeah i had /24 on cable [18:11] it was nice that you could just plug it into a pc [18:12] same with Verizon DSL here kind of [18:12] set an ip and gateway and you were off [18:12] verizon is vdsl now right? [18:12] except Verizon caches your MAC address for DHCP, so you can't change computers without calling them first [18:12] or spoofing the MAC of course [18:12] with some shitty router that everyone puts their own one after [18:12] no, ADSL [18:12] 2 [18:12] oh weird [18:12] i'm sure i had a friend who went comcast -> verizon -> comcast [18:13] comcast was higher latency apparently [18:13] that's kind of hard to believe [18:13] and only like 30 megabit [18:13] he was in kansas [18:13] Verizon DSL sucks crap [18:13] i think vz can offer vdsl2 if you're close to their gear [18:13] oh [18:13] like..sub 1000ft loop length [18:13] i meant verizon was oops [18:13] sorry! [18:13] I'm less than that from their CO [18:13] and comcast was 50 megabit i think? [18:13] old dslams maybe in that facility [18:14] where in the US are you? [18:14] central coast of california [18:14] 93455 [18:14] old GTE territory [18:14] huh, weird - business i used to work at had vdsl service in huntington beach area ca [18:14] heh i have friend in san jose, and he said comcast was pretty bad [18:14] but it's basically comcast or at&t [18:15] i suppose comcast is better than at&t [18:15] comcast is in the middle of doubling residential speeds again [18:15] at least they actually upgrade their network sometimes [18:15] he has heaps of jitter [18:15] and really high pings to cogent [18:15] it's about 50 msec pings to san jose from san jose [18:16] over cogent [18:16] peering congestion you think? [18:16] this was a while ago [18:16] the routing is probably goofy [18:16] before the netflix peering [18:16] routing looked fine [18:16] it's probably the netflix/cogent/comcast dispute [18:16] wouldn't have surprised me if it went SJC>LAX>Cogent>SJC or something [18:17] for some reasno people call it the netflix issue [18:17] but it affects other traffic too [18:17] my mtr to cogentco.com: http://paste.unixcube.org/k/efacc8 [18:17] nah it didn't [18:17] yeah [18:17] it did over 3mb/sec to los angeles though [18:18] on 25 megabit plan [18:18] mci [18:18] ok it wasn't that broken [18:18] hahaha [18:18] i've seen that from cogent to at&t [18:18] oh that's to cogent's website [18:18] try sj.meh.net.nz [18:19] via nlayer [18:19] oh [18:19] http://paste.unixcube.org/k/ea49f6 [18:19] ok that's bbetter [18:19] it was going via comcast before [18:19] cogent denver pop -> albuquerque, nm (460mi) is 55ms [18:19] maybe they stopped sending via cogent when netflix paid money [18:20] cogent LAX pop -> albuquerque = 27ms [18:20] 800mi [18:20] hmm that ping is still kind of high though [18:20] what do you get to arp? [18:21] 28ms [18:21] he got lower ping than that to arp [18:21] http://paste.unixcube.org/k/7cabf5 [18:21] i don't really know what santamaria is [18:21] he was in santa clara? [18:21] right next to santa barbara [18:21] but they prob not close [18:21] right in the middle of lax and sfo [18:21] nice area of ca [18:22] oh [18:22] my Verizon traffic goes via lax [18:22] i've spent a fair amount of time in ventura & carpinteria for work [18:22] so the issue is that there's no peering there [18:22] and it has to go to sj/la [18:22] or both [18:22] and my Comcast trafic goes via sj [18:22] yeah [18:22] weird google says santa marisa is in crazil [18:23] santa maria brazil [18:23] i can't type [18:23] http://binged.it/1i9ZuWW [18:23] http://binged.it/1i9ZuWW -> https://www.bing.com/maps/?v=2&where1=Santa Maria, CA&form=LMLTSN&cp=34.95372009277341~-120.4355697631836&lvl=12&sty=r&encType=1 [18:23] oh i see where it is now [18:23] that does look nice [18:24] it looks samll though [18:24] i like that area of ca a lot [18:24] it's pretty nice :) [18:24] last time i went was last june, it was 65 every day [18:24] so nice [18:24] does it rain there? [18:24] we're in a pretty bad drought right now [18:24] so not much [18:25] that's the most disturbing thing about california to me [18:25] yeah, it is pretty bothersome [18:25] it was a lot better some years ago [18:26] wow [18:26] it rains over 100 times more here than there [18:26] a good friend of mine used to work for the UCSB NOC a few years back [18:27] 1,212.4 inches per year, compared to 14.01 inches per year [18:27] haha [18:27] so yeah it seems a ltitle disoncerting :) [18:27] http://goo.gl/Bw1jei [18:27] the local CO [18:27] http://goo.gl/Bw1jei -> https://www.google.com/maps/@34.883954,-120.418628,3a,75y,91.38h,85.04t/data=!3m4!1e1!3m2!1scvaM7PWqCG7UQ9E4kfPquQ!2e0 [18:27] wait.. [18:27] 1,212 inches = 100ft of rain [18:27] northern california rains more? [18:27] haha [18:27] tahts' per year [18:28] mm [18:28] wikipedia shows inches in parenthesis [18:28] 1212.4mm [18:28] oh it's precipitation vs rainfall [18:28] is that the same thing [18:28] yes [18:28] the parenthesis is 47.732" [18:28] oh i fucked up didn't i [18:28] yes [18:28] backwards, lol [18:29] they swapped it aruond [18:29] *** mus1cb0x has left "WeeChat 0.4.2" [18:29] i was trying to use inches for US audience :/ [18:29] yeah, i think because you're metric and we're lame [18:29] sorry [18:29] well i expected wikipedia to be constant [18:29] ok that difference isnt' so bad [18:29] it's just 4x as much [18:30] we get 9.45 in/yr [18:30] i'd rather 14 :/ [18:30] you and i both [18:30] i dunno [18:30] haha [18:30] haha [18:30] i'm also in the desert [18:30] nice [18:31] when i was younger i thought it'd be cool to get a job in the US [18:31] but you need work visa and to work for one company for ages :/ [18:31] my house is at ~1800m above sea level [18:31] my friend did it by shifting within the same company to a diff country [18:31] but it ook him two attempts [18:32] yeah, it's a pain [18:32] there wsa some paperwork error or something [18:32] i have a friend who's finishing up her fellowships in the US as a pediatric orthopedic surgeon [18:32] and they're still not going to let her stay, she has to return to brazil at the end of the year [18:32] and you can't fix it you have to wait until next year? [18:32] yeah, it's a bureaucratic mess [18:32] damn [18:33] legal immigration into the us is gross [18:33] i wonder how he managed it [18:33] another friend got married in canada, and it took 6 months for his wife to legally immigrate to the US [18:33] and ~$5k in attorney fees [18:33] ouch [18:33] he must have done it properly because he bought a house [18:33] and hours upon hours at US consulates for meetings with immigration clerks and stuff [18:34] apparently there's ths really exepensive grooming thing for houses when they sell [18:34] and therew as like a video walk through and stuff [18:34] that doesn't happen here at all [18:34] but it was actualyl cheaper than i thought it'd be [18:34] huh [18:34] they show this video of the house [18:34] going through all the rooms [18:34] with music [18:34] and panning [18:35] hahaha, yeah, i've seen that before [18:35] and everything looks so neat and tidy [18:35] and sterile [18:35] yeah, they "stage" the house [18:35] sometimes they do it empty, sometimes they rent furniture and set it up so you can get an idea of what it'd look like if you lived there [18:37] oh that's the term yes [18:41] *** tellnes has quit IRC (Ping timeout: 252 seconds) [18:47] *** tellnes has joined #arpnetworks [20:38] oh, great [20:39] my smokeping graph looks like acf_'s verizon one [20:39] hahaha [20:40] yeah, seeing roughly 2x the latency at this hop 10. ge0-arpnet.cust.lax07.mzima.net [20:42] looks like it's been like this daily since the 3rd [20:45] https://twitter.com/j_smedley/status/475023041106169856 :O [20:45] TWITTER: looking good for a Waterson and Mattherson merge. (Fri Jun 06 21:14:53 +0000 2014, retweeted 50 times) [20:57] did anyone not on kvr15 get a maintenance announcement for kvr15 ? [21:04] i didnt notice anything [21:04] kvr14 is goiung down too [21:04] and somethjing else [21:15] m0unds: mind revealing the source destination network/host? [21:16] /s/source destination/source/ [21:17] (i'm on kvr15 so don't know if they all say that) [21:35] m0unds are you on Comcast? [21:36] http://kremvax.acfsys.net/smokeping.cgi?target=Local.phoenix [21:36] that is rather upsetting [21:37] crap now comcast <-> nlayer is bad... [21:38] or is it comcast <-> ntt? [21:38] my forward path is via nlayer [21:38] and return is via ntt [21:39] from Comcast's perspective [21:40] hmm if you're seeing loss at ge0-arpnet.cust.lax07.mzima.net [21:40] it makes me think ntt [21:40] because ntt becomes the return path at that hop [21:52] definitely NTT: http://paste.unixcube.org/k/65f903 [22:01] sorry, was commuting home - i'm on comcast biz [22:02] it's nlayer inbound from comcast -> arp [22:03] and return path is via ntt [22:03] and i think it's ntt [22:05] it stops being problematic at precisely midnight mdt [22:05] more peering problems I assume... [22:05] guessing so [22:05] starts at the same time [22:05] ends at the same time [22:05] I'll email NTT again [22:06] not that it'll help any [22:06] are you seeing this stuff starting at around 1530ish PDT? [22:06] it starts for me at 1630 mdt, ends at midnight +/- 5minutes [22:07] yepyep [22:07]