[00:03] *** gcw|mini1 has quit IRC () [00:23] *** robnerd is now known as robonerd [00:37] *** xiphias has quit IRC (Ping timeout: 240 seconds) [00:38] *** xiphias has joined #arpnetworks [00:43] *** xiphias has quit IRC (Ping timeout: 240 seconds) [00:44] *** xiphias has joined #arpnetworks [00:50] *** xiphias has quit IRC (Ping timeout: 240 seconds) [00:51] *** xiphias has joined #arpnetworks [00:51] *** xiphias has quit IRC (Changing host) [00:51] *** xiphias has joined #arpnetworks [02:07] *** SpeedBus has quit IRC (Ping timeout: 272 seconds) [02:07] *** mnathani has quit IRC (Ping timeout: 272 seconds) [02:09] *** mnathani has joined #arpnetworks [02:10] *** SpeedBus has joined #arpnetworks [06:48] *** m0unds has left "taking down ipv6" [06:57] up_the_irons: no packet loss so far [06:59] *** heavysixer has joined #arpnetworks [06:59] *** ChanServ sets mode: +o heavysixer [07:07] *** m0unds has joined #arpnetworks [07:08] *** xiphias has quit IRC (Ping timeout: 240 seconds) [07:09] *** xiphias has joined #arpnetworks [07:13] hmm, I see v6 traffic but not v4 traffic (v4 gw at my vps is 'ping: sento: Host is down' ugh [07:14] weird [07:15] i had some weird thing with my /48 that made me think i screwed up configuration, but turned out it was something else [07:15] unrelated to me fatfingering anything, which was nice [07:15] odd I have one vps that works and another which doesn't [07:15] huh [07:15] bad vlan config or something? [07:15] aka I get icmp replies from the router from a different host on the same vlan [07:16] yeah, sounds like it could be [07:16] can ping from hosta -> hostb and hosta -> gw, but hostb does not reach the gw [07:17] manually setting arp yields little success either, hrmph [07:20] guess I'll try powering off the vps and powering it back on incase it re-plumbs something [07:20] v6 works so I think its external to the vps itself though [07:26] *** heavysixer has quit IRC (Quit: heavysixer) [08:44] *** heavysixer has joined #arpnetworks [08:44] *** ChanServ sets mode: +o heavysixer [10:06] *** TheHiTCH_ has quit IRC (Read error: Connection reset by peer) [10:23] *** TheHiTCHO has joined #arpnetworks [10:36] *** heavysixer has quit IRC (Quit: heavysixer) [10:38] *** heavysixer has joined #arpnetworks [10:38] *** ChanServ sets mode: +o heavysixer [10:47] woo [10:49] *** qbit has quit IRC (Quit: leaving) [11:00] hmm, still no IPv4 access from my kvr22 vps .. anyone else on kvr22 ? [11:15] *** heavysixer has quit IRC (Read error: No route to host) [11:16] *** heavysixer has joined #arpnetworks [11:16] *** ChanServ sets mode: +o heavysixer [11:16] yep [11:17] % ping google.com [11:17] PING google.com (173.194.33.2): 56 data bytes [11:17] 64 bytes from 173.194.33.2: icmp_seq=0 ttl=53 time=27.247 ms [11:18] when did you lose ipv4? [11:19] *** heavysixer_ has joined #arpnetworks [11:19] *** ChanServ sets mode: +o heavysixer_ [11:20] toddf: so is this a new host on an existing account/vlan? Did you get another /30? Otherwise, there's only one usable IP in the /30 you normally get.... [11:21] *** TheHiTCH_ has joined #arpnetworks [11:22] *** heavysixer_ has quit IRC (Client Quit) [11:22] nothing changed. [11:22] it is my 2nd oldest host in a group of 4 in this one account/vlan [11:23] brycec: just woke up this morning to no response on v4 but v6 works [11:23] stranger yet I can hit v4 on the other vps'en just not the gateway from this one host [11:23] toddf ? haha, nice to see you over here too! :) [11:23] Sounds like a good time to email up_the_irons [11:23] I don't even get arp is-at from the gateway from my arp who-has request on the afflicted vps [11:23] robonerd: you culled me from here to #coindev, remember? [11:24] brycec: done so a while back [11:24] fun reality is this is my mail server, so unless responses from tinder come via IPv6 he can't reach me back, emailed a followup from gmail as well [11:24] toddf yea just forgot because you've become such a regular :D [11:27] *** heavysixer has quit IRC (*.net *.split) [11:27] *** TheHiTCHO has quit IRC (*.net *.split) [11:27] *** phlux has quit IRC (*.net *.split) [11:27] *** avj has quit IRC (*.net *.split) [11:28] *** xiphias has quit IRC (Ping timeout: 240 seconds) [11:29] *** hazardous has quit IRC (Ping timeout: 248 seconds) [11:30] huh. [11:30] *** hazardous has joined #arpnetworks [11:31] *** xiphias has joined #arpnetworks [11:34] so .. anybody else on kvr22 ? [11:34] *** phlux has joined #arpnetworks [11:34] yes [11:35] able to ping 8.8.8.8 ? [11:35] able to ping whatever [11:35] can you ping 208.79.89.90 ? [11:35] % ping 8.8.8.8 [11:35] PING 8.8.8.8 (8.8.8.8): 56 data bytes [11:35] 64 bytes from 8.8.8.8: icmp_seq=0 ttl=50 time=26.977 ms [11:35] no [11:35] how about .91 ? [11:35] no reply from that [11:36] yes [11:36] 64 bytes from 208.79.89.91: icmp_seq=0 ttl=253 time=0.486 ms [11:36] *** xiphias has quit IRC (Ping timeout: 240 seconds) [11:36] .90 is on kvr22 .. v4 issues .. .91 is on kvr14 .. v4 works fine [11:36] same vlan [11:36] so its not a cabling issue to the gateway, you're able to do v4 fine from kvr22 [11:37] and its not blocking on my host (I can tcpdump and see traffic flowing out, but not in) [11:37] and I can ping between my vps on v4 [11:37] just the gateway doesn't respond to my .90 ip [11:37] time to try an IPv4 alias I guess [11:37] incase somehow my .90 ip got blacklisted for $automated_bogus_reason or somesuch [11:37] *** xiphias has joined #arpnetworks [11:38] not that I'm aware of any $automated_reasons ever but I'm grasping at straws at this point [11:40] *** qbit has joined #arpnetworks [11:43] *** xiphias has quit IRC (Ping timeout: 240 seconds) [11:44] *** xiphias has joined #arpnetworks [11:44] grmph, even an inet alias doesn't speak v4 for this system, what gives I wonder? [11:49] *** xiphias has quit IRC (Ping timeout: 240 seconds) [11:50] *** xiphias has joined #arpnetworks [11:56] *** xiphias has quit IRC (Ping timeout: 240 seconds) [11:57] *** xiphias has joined #arpnetworks [12:05] *** xiphias has quit IRC (Ping timeout: 240 seconds) [12:07] *** xiphias has joined #arpnetworks [12:14] *** xiphias has quit IRC (Ping timeout: 240 seconds) [12:15] *** xiphias has joined #arpnetworks [13:08] *** r0ni has joined #arpnetworks [13:20] I was wanting to know if there is a way to find out why my computer is acting like it is on dailup when I am on cable and getting my full speed [13:20] Yes. Next question? [13:22] brycec: is there a santa claus/ [13:27] I was wanting to know if there is a way to find out why my computer is acting like it is on dailup when I am on cable and getting my full speed [13:31] LLKCKfan the past few years i've seen the US internet really slow down [13:32] massive latency added to almost every back haul/transit [13:32] on a lot of nodes [13:32] i have a feeling it's data snooping + channel splitting [13:37] .it is not my speed [13:42] m0unds: As long as you believe, yes. [13:44] LLKCKfan: Just curious, what makes you think #arpnetworks is a good place to ask that question (over, and over, and over)? [13:48] hmm [13:49] LLKCKfan: how is babby formed? [13:51] *** xiphias has quit IRC (Ping timeout: 240 seconds) [13:52] *** xiphias has joined #arpnetworks [13:54] *** tmarble has joined #arpnetworks [13:55] up_the_irons: did you see my e-mail? [14:18] tmarble: if you sent email to support@arpnetworks.com then you'll get an automated response that says it's been received; when he responds is not guaranteed .. I've been down all day waiting on a v4 issue that I've never seen before [14:20] toddf: ok... it's kind of a personalized followup... not really apropos to escalate to support@ (yet :) [14:20] * tmarble in UTC+1 atm... off to bed :) [14:40] toddf: can you tunnel your traffic from one box to the other? [14:40] I've done so for mail [14:41] voip is not quite so easy [14:41] dns .. no tunnel required, it is resiliant [14:41] when you say you're on the same vlan on both boxes [14:41] i assume that means you can use a private ip address [14:41] and talk between the two [14:41] i dunno if you've doen that or not [14:41] you should know [14:42] but i'd be curious if that was working [14:42] at arpnetworks there is a single vlan for all boxes under one account [14:42] yeah [14:42] I can do svlan(4) between the systems (providing arpnetworks removes a restriction that blocks it by default) [14:42] and I do end up doing that also [14:42] oh ok i fuond that vlan didn't work [14:42] vlan on vlan [14:43] yes you can't do vlan inside vlan when he does vlan himself [14:43] but you can do svlan(4) because its intended to be nested inside vlan(4) [14:43] ahh right [14:43] well the only tiem i had shared vlan was when i had the beta vm [14:43] but anyway, the boxes can reach each other? [14:43] yes [14:43] I can reach via v4 [14:43] v6 has always worked [14:43] but the one box cannot get even an arp entry to the v4 gateway [14:44] just nothing comes in [14:44] so can you proxy arp on the working box [14:44] and forward traffic to the non working box? [14:44] with no tunnel [14:44] that sounds complicated [14:44] i wonder where up_the_irons is [14:44] hadn't thought of that, that would do inbound, but outbound .. route through my other vps I guess? meh [14:44] busy I'm sure [14:44] hmm [14:45] does outbound static arp work? [14:45] tried it, no go [14:45] hmm [14:45] I also confirmed another arpnetworks customer on kvr22 (where my afflicted vps resides) can reach the internet [14:45] ew're thjinking up complicated ways aren't we :/ [14:45] so I think it is something specific with my vlan between kvr22 and the v4 router [14:45] i wonder if it's a mac address clash [14:45] Sounds like toddf's vlan has become disconnected from the v4 router. [14:45] i dunno what the automated mac creation is like [14:46] (Oh wait, you said other v4 hosts are fine. hm) [14:46] brycec: except the vlan works from other kvr systems .. kvr27,kvr28,kvr14 [14:46] so the map is [14:46] does the IP address with on your othewr host? [14:46] Yeah, I ack'd that. [14:46] kvr27+kvr28+kvr14+kvr22 -> v6 ok [14:46] kvr27+kvr28+kvr14 -> v4 ok [14:46] kvr22 -> v4 !ok [14:47] if ip the other ip address works on the other host then i would anycast it :/ [14:47] ie, put the same ip on both hosts [14:47] then enable forwarding on the working box [14:47] how do you anycast w/out a mac conflict [14:47] sure I did this convoluted setup at first [14:47] and set your default host [14:47] i was having issues on my 22 box w/ipv6 packet loss last night [14:47] to avoid getting a /29 [14:47] then bounce the traffic from the working host [14:47] oh hmm [14:47] but VoIP love was not there, so I dropped it when I needed yet another separate v4 address [14:47] it doesn't need to have an actual ip address on the working host [14:47] it just needs to arp for it [14:48] and route to the right place [14:48] mac conflicts don't matter [14:48] I have everything working but VoIP .. guess I could try to nat VoIP out another ip or somesuch, bleh [14:48] well they don't most of the time [14:48] as long as either host works [14:48] but yeha you want proxy arp [14:48] I tried putting another IP on the afflicted vps, and it didn't work any better [14:48] rather than actual anycast [14:49] with bgp you could just advertise the ip as a /32 [14:49] guess I should check e.g. kvr14 to see if arp who-has is being broadcast for the afflicted ip [14:49] from the router [14:49] yeh i think it's mac address related [14:49] I tried changing my mac! [14:49] does that work? [14:49] and it came back with v6 just fine, v4 no change [14:49] gah [14:49] it is as if the plubmbing between kvr22 and the v4 router for my vlan only is busted [14:50] did you get your port shifted to gigabit? [14:50] yes [14:50] i assuem that's where the problem is then [14:50] and the working one didn't? [14:50] all of my vps'en are gigabit so far as I know [14:50] all 4 [14:50] damnit [14:50] ;-) [14:51] definitely makes no sense, given that working paths overlap with the nonworking path. :( [14:51] I'm almost leaning towards something blowing some automated trigger in the switch for my vps traffic or something, though we've been repeatedly told no automatic triggers except port connection throttling on 22 [14:51] so I'm guessing some wierd switch failure or somesuch [14:51] well I'm going to presume there are multiple switches involved [14:51] There's a UDP rate limit as well. But that's not a block. [14:51] that's why i was wondering if it effected gigabit vps [14:51] but not the oold one [14:52] and that likely kvr14 is plugged into a different switch than kvr22 vs kvr28/kvr27 [14:52] err port [14:52] i'm on kvr15 i think [14:52] and i haven't experienced issues [14:52] so it could be a misfire on the vlan config between the kvr22 switch and the v4 router, but not the v6 router [14:52] it coul dbe [14:52] feel free to compare 0.v.freedaemon.com vs 2.v.freedaemon.com ;-) [14:53] so [14:53] if you do proxy arp [14:53] and forward to the internal ip address [14:53] can you see receive traffic [14:53] ah, just realized another cluebit [14:54] kvr27 cannot reach kvr22 via v4 [14:54] nor v6 [14:54] hmm [14:54] but can via ipv6? [14:54] but kvr27 can reach google via v4 and v6 [14:54] well i'd g down the arp -s ... pub [14:54] route [14:55] and th en put it back when it's working right [14:55] 16:54:24.985632 00:1f:6c:92:7f:00 ff:ff:ff:ff:ff:ff 0806 60: arp who-has 208.79.89.90 tell 208.79.89.89 [14:55] I see that at kvr14 [14:55] but I see this at kvr22 [14:55] 16:54:44.563261 52:54:00:ef:41:22 ff:ff:ff:ff:ff:ff 0806 42: arp who-has 208.79.89.89 tell 208.79.89.90 [14:55] I see the 2nd packet at kvr14 also [14:56] but the 1st packet I don't see at kvr22 [14:56] so arp magic is not fixing my ethernet segment breakage between kvr22 and v4 router [14:56] i just realised.. [14:56] when iw as saying about doing arp stuff.. i was thinking you wouldn't have stateful filtering [14:56] but you migt [14:56] and that can break too [14:56] yes [14:57] I'm going to try it on a vps that doesn't have any fancy filtering [14:57] ahh [14:57] with openbsd you have to append no keep state [14:58] toddf: can you give it another try [14:58] up_the_irons: hi! [14:58] workie! [14:58] toddf: this is my fault; i made a change on kvr22 yesterday, and something broke :( [14:58] I apologize [14:58] voip phone registered and all manner of things are working now [14:58] (it only affected people on the GigE router, which is very few) [14:58] w00t nice [14:59] kvr27 can now talk to kvr22 via v4 as well [14:59] on my vlan [14:59] The prodigal up_the_irons returns! [14:59] lol [14:59] *** heavysixer has joined #arpnetworks [14:59] *** ChanServ sets mode: +o heavysixer [15:00] it was fun given another user was on kvr22 and his v4 worked fine, but didn't think to ask about gige bits [15:00] now my backup bogus backup mx works [15:00] yeah sorry for the wasted diagnostic time [15:01] I'm understanding of the scenario given I've been in your shoes more often than not [15:01] (It's not like there was anything else to do while it was down, right? :P) [15:01] brycec: exactly, I have all 3 dns servers working now as well as a result [15:01] lol good :) [15:02] toddf: I assume geographically diverse too? [15:02] oh up_the_irons is around :) [15:02] * brycec pays dns.he.net $0 to provide some very nice dns service [15:02] haha [15:02] they send you invoices for $0 [15:03] No... [15:03] brycec: two at arpnetworks (one was misconfigured aka firewalled to /dev/null) and one at home (suceptable to power outages) [15:03] oh, you actually do pay them? i figured you meant the free authoritative stuff [15:03] i use route53 for critical stuff [15:03] m0unds: I use their free stuff. There's no invoice involved. It's my authoritative too. [15:04] oh, i was joking about the $0 invoice (cuz it's free) [15:04] I highly recommend it, even if just for backup. Can't beat 5 separate anycast servers. [15:04] I do IT consulting and service an isp in my client portfolio. if I can't get dns and mail and such right, why bother? sure I could outsource to dns.he.net but where's the ability to say "i do this for myself, I can do this for you too" ? ;-) [15:05] i hate web interfaces for dns myself [15:05] I see your point. Even so, I would suggest using them for backu/slave. Part of doing IT is knowing good vendors after all [15:05] he.net is good now? :) [15:05] wwere they evil before? [15:05] they're good at supporting ipv6. [15:05] they had heaps of power outages at one of their datacentres [15:05] fremont? [15:06] Ah. I've had issues with their tunneling, absolutely. [15:06] and they're generally known to be subpar for ipv4 connectivity [15:06] But never a DNS issue. [15:06] but cheap [15:06] in ipv6 they're pretty good though [15:06] i dunno, i don't even know who's good :/ [15:07] i mean some people say level3 are good, but level3 still have issues [15:07] it's well known that cogent are bad bad bad [15:07] agreed [15:07] it's generally consdiered that at&t aren't that great [15:08] for a wihle a lot of people seemed to be pushing web sites to cloudflare [15:08] and omg, so many performance issues suddenly with sites that shifted [15:09] funny, btc-e.com is on cloudfare [15:09] i'd still probably consider some of the better cdn providers to have higher qaulity dns though [15:09] is it randomly slow? [15:09] they do have occasional hiccups, and indeed it is randomly slow [15:09] I just programmed patience into my bot and don't generally notice as a result [15:09] like 5 seconds to load a page slow? [15:10] and was it reasonble consistent prior? [15:10] i mean some sites that moved to cdn's had backend issues prior like for instance reddit [15:10] so it can be hard to know if it's the cdn or the backend [15:10] like I know about these errors enough to put them into the public api: [15:10] https://github.com/toddfries/Finance-btce/blob/master/lib/Finance/btce.pm#L375 [15:10] but generally speaking, if a site performs consistently, then goes on cdn and goes randomly slow, i blame the cdn [15:11] I've never known btc-e.com before cloudfare so I can't comment [15:11] hahahahaha [15:11] as an end user i've found cachefly consistently good [15:11] i think it's kind of expensive though [15:12] yeah from $99/month [15:14] with monitoring i do on page loads for clients on paid cloudflare, the page loads from a bunch of locations in the us are within 5% avg [15:14] maybe it's an international thing, idk [15:14] but +/- 5% speed in ms for page loading from cloudflare [15:14] e.g. for eyeballs, not noticible [15:15] *** heavysixer has quit IRC (Quit: heavysixer) [15:23] it may be an international thing [15:23] but i was getting slow performance when it hit the [15:23] hangon it was slow performance when i hit the CA node.. [15:24] but i think it wasn't so bad with the TX node [15:24] from a vps [15:24] but i suppose CA may get more ddos attacks from china :/ [15:25] yea [15:26] *** [NSA] has joined #arpnetworks [15:27] LOL [15:27] the [NSA] has arrived [15:28] oh the new dc thing is happening next year isn't it? [15:28] [NSA]: meet [FBI] [15:34] that is one of my goals, yes [15:35] cool [15:54] *** heavysixer has joined #arpnetworks [15:54] *** ChanServ sets mode: +o heavysixer [16:09] *** heavysixer has quit IRC (Quit: heavysixer) [16:21] *** heavysixer has joined #arpnetworks [16:21] *** ChanServ sets mode: +o heavysixer [16:33] *** heavysixer has quit IRC (Quit: heavysixer) [17:17] *** heavysixer has joined #arpnetworks [17:17] *** ChanServ sets mode: +o heavysixer [17:29] *** heavysixer has quit IRC (Quit: heavysixer) [17:44] *** r0ni has quit IRC (Ping timeout: 240 seconds) [19:17] *** heavysixer has joined #arpnetworks [19:17] *** ChanServ sets mode: +o heavysixer [19:24] I was wanting to know if there is a way to find out why my computer is acting like it is on dailup when I am on cable and getting my full speed [19:28] *** TheHiTCH_ has quit IRC (Remote host closed the connection) [19:28] *** TheHiTCHO has joined #arpnetworks [19:29] *** TheHiTCHO has quit IRC (Remote host closed the connection) [19:29] *** TheHiTCH_ has joined #arpnetworks [19:31] LLKCKfan: No, there isn't. [19:32] *** TheHiTCH_ has quit IRC (Remote host closed the connection) [19:32] *** TheHiTCH_ has joined #arpnetworks [19:32] *** heavysixer has quit IRC (Quit: heavysixer) [19:35] Therehas to be [19:43] No way. [19:55] *** TheHiTCH_ has quit IRC (Remote host closed the connection) [19:55] *** TheHiTCHO has joined #arpnetworks [19:56] You do not want to help [19:59] LLKCKfan: you keep asking the same damn question, over and over, without providing information. Why do you even ask in #arpnetworks at all?? [20:00] *** TheHiTCHO has quit IRC (Ping timeout: 260 seconds) [20:13] And then silence... We ask questions, you don't answer. Why do you bother? [20:34] *** TheHiTCHO has joined #arpnetworks [21:47] 1i want to say that the answer might be because you're using a rural 'cable company' that maxes out at 512kbps [21:47] and has 10gb caps [21:47] after which you're throttled to 64kbps [21:47] and they apparently have a single t1 total [21:48] lolol [22:37] *** LLKCKfan has quit IRC (Ping timeout: 240 seconds) [22:41] *** LLKCKfan has joined #arpnetworks [23:47] I was wanting to know if there is a way to find out why my computer is acting like it is on dailup when I am on cable and getting my full speed [23:50] LLKCKfan: No. [23:54] I GET MY FULL SPEED [23:54] THAT IS NOT WHAT I AM ASKING ABOUT [23:58] LLKCKfan: No.