| ↑back Search ←Prev date Next date→ Show only urls | (Click on time to select a line by its url) |
| Who | What | When |
|---|---|---|
| *** | Guest88801 is now known as easymac
easymac is now known as Guest55375 | [00:48] |
| ............. (idle for 1h0mn) | ||
| Guest55375 is now known as easymac
easymac is now known as Guest45837 | [01:49] | |
| ............. (idle for 1h1mn) | ||
| Guest45837 is now known as easymac
easymac is now known as Guest61474 | [02:50] | |
| ............. (idle for 1h0mn) | ||
| Guest61474 is now known as easymac
easymac is now known as Guest79080 | [03:50] | |
| ............. (idle for 1h0mn) | ||
| Guest79080 is now known as easymac
easymac is now known as Guest90147 | [04:51] | |
| ............. (idle for 1h0mn) | ||
| Guest90147 is now known as easymac
easymac is now known as Guest69670 | [05:52] | |
| .... (idle for 16mn) | ||
| staticsafe | mercutio: you around? | [06:08] |
| mercutio | yip
what's up | [06:08] |
| staticsafe | mercutio: my v6 prefix's announce disappeared sometime last night, as far as I can see the prefix is exported on my end. Can you take a look?
2620:98:4001::/48 | [06:09] |
| mercutio | ok
yeah that is curious i can see 4000 but not 4001 but 4000 isn't going via arp | [06:09] |
| staticsafe | i can reach it from my nagios instance indicating some peers are seeing it
(softlayer) | [06:14] |
| mercutio | so he.net isn't seeing it | [06:14] |
| staticsafe | yeah | [06:14] |
| mercutio | is the /48 just advertised via ape
arp even | [06:15] |
| staticsafe | yeah | [06:15] |
| mercutio | with having no path via a supporting /32 or such
i think there's some route object issues with your subnet getting out in general and he.net's been having issues hmm so 2620:98:4000::/48 isn't advertised by arp | [06:15] |
| staticsafe | no, its advertised elsewhere | [06:21] |
| mercutio | yeah it seems to be advertised anyway, due to the way the filters are setup
this needs fixing :) do you want the ability to advertise 4000 still? | [06:22] |
| ....... (idle for 31mn) | ||
| *** | Guest69670 is now known as easymac
easymac is now known as Guest71394 | [06:53] |
| ............. (idle for 1h1mn) | ||
| Guest71394 is now known as easymac
easymac is now known as Guest55703 | [07:54] | |
| ............. (idle for 1h1mn) | ||
| Guest55703 is now known as easymac
easymac is now known as Guest30476 | [08:55] | |
| ............. (idle for 1h1mn) | ||
| Guest30476 is now known as easymac
easymac is now known as Guest13865 | [09:56] | |
| ............. (idle for 1h0mn) | ||
| Guest13865 is now known as easymac
easymac is now known as Guest97469 | [10:56] | |
| ............. (idle for 1h0mn) | ||
| Guest97469 is now known as easymac
easymac is now known as Guest78531 | [11:57] | |
| ............. (idle for 1h1mn) | ||
| Guest78531 is now known as easymac
easymac is now known as Guest1206 | [12:59] | |
| ............. (idle for 1h0mn) | ||
| Guest1206 is now known as easymac
easymac is now known as Guest36637 | [13:59] | |
| ............. (idle for 1h0mn) | ||
| Guest36637 is now known as easymac
easymac is now known as Guest85919 | [15:00] | |
| ............. (idle for 1h1mn) | ||
| Guest85919 is now known as easymac
easymac is now known as Guest89094 | [16:01] | |
| ............. (idle for 1h1mn) | ||
| Guest89094 is now known as easymac
easymac is now known as Guest46254 | [17:02] | |
| ...... (idle for 28mn) | ||
| sjackso has quit IRC (Quit: leaving) | [17:30] | |
| ...... (idle for 26mn) | ||
| m0unds has quit IRC (Quit: WeeChat 1.1.1)
m0unds has joined #arpnetworks | [17:56] | |
| Guest46254 is now known as easymac
m0unds has quit IRC (Quit: stupid tmux) | [18:02] | |
| mercutio | tmux is great, dunno what he's talking about :) | [18:03] |
| *** | easymac is now known as Guest91502 | [18:03] |
| staticsafe | hrm, my prefix is gone again | [18:04] |
| mercutio | oh? | [18:04] |
| staticsafe | yeah | [18:04] |
| mercutio | damn hangon
should be back trying to fix these filters up better but maybe i shoudl wait until a bit later | [18:04] |
| staticsafe | :o | [18:07] |
| brycec | The only time tmux has ever fouled me up beyond recovery was when I upgraded tmux and couldn't reattach to an existing session running the previous binary. (And even then, the interim solution was to downgrade) | [18:15] |
| m0unds_ | i'm having refresh issues w/tmux
on one particular client, not on another so it's annoying as hell so..in this instance, annoying and not so great | [18:16] |
| brycec | What exactly is a refresh issue in tmux? | [18:16] |
| m0unds_ | when you switch between windows and it redraws the content in it
like..if text is scrolling or something | [18:16] |
| brycec | Mmhm
never had an issue that redraw/switching windows didn't fix | [18:16] |
| m0unds_ | switch to the other window, slow redraw
switch back, slow redraw it's irritating | [18:17] |
| brycec | I blame IPv6 >.> | [18:17] |
| m0unds_ | it's like i'm running it over a serial connection | [18:17] |
| brycec | <.< | [18:17] |
| m0unds_ | haha, seems legit | [18:17] |
| mercutio | that sounds like a terminal issue
are you using putty or something | [18:17] |
| m0unds_ | doesn't matter | [18:17] |
| mercutio | oh hangon i've seen something like that before m0unds. | [18:17] |
| m0unds_ | i've connected to it different ways, behaves the same regardless | [18:17] |
| brycec | in light of recent network issues it's legit. (though not to worry, not seeing anything at this moment :) ) | [18:17] |
| m0unds_ | it's not on arp :) | [18:18] |
| mercutio | some terminal was insanely slow with radeon view drivers.
s/view/video/ | [18:18] |
| BryceBot | <mercutio> some terminal was insanely slow with radeon video drivers. | [18:18] |
| mercutio | and i seem to remember tmux did something that made it slower | [18:18] |
| m0unds_ | this client (a raspi) is fine | [18:18] |
| mercutio | probably something weird with the way it does background colours or some other less common thing | [18:18] |
| brycec | protip: Don't PM brycec, he won't see it for at least 20minutes :p | [18:21] |
| mercutio | heh
i used to have huge issues with notion and radeon video drivers. whenever i resized windows using line drawing it was painfully slow the fallback path for unaccelerated stuff is shocking. | [18:21] |
| brycec | fwiw mercutio, trace from my home to ARP looks to be taking the same route as it has before. But at the moment, mostly clean. Dropped 3 out of 300 packets. | [18:22] |
| mercutio | it's the path from arp to you that may be different atm | [18:22] |
| brycec | mmkay I'll look in a sec :)
I can see the same nightly IPv6 abuse on ARP starting again in Smokeping https://smokeping.cobryce.com/?target=ARP.Upstream6 (that's from my ARP VPS to ARP's v6 router [i believe]) | [18:23] |
| mercutio | heh
there is another change to come | [18:24] |
| brycec | dun dun DUN | [18:25] |
| mercutio | yeah the nightly abuse is pretty bad
it seemed to start a few minutes late tonight | [18:25] |
| brycec | I do see packet loss the first hop after ARP (ge-101-0-0-13.r04.lsanca03.us.bb.gin.ntt.net) (my mtr to the feed:dead address) | [18:26] |
| mercutio | i saw 98% loss to that hop
i think it's gone some chronic icmp deprioritisation s/gone/got/ | [18:26] |
| BryceBot | <mercutio> i think it's got some chronic icmp deprioritisation | [18:26] |
| brycec | 80%+ over the last 2 minutes | [18:26] |
| mercutio | the hop one after was fine though right | [18:27] |
| brycec | Yeah could be (I'm well aware of that pifall)
Right | [18:27] |
| mercutio | yeah | [18:27] |
| brycec | And there's another ntt.net hop that's lossy, but through to the destination is clear.
mercutio: I don't suppose ARP can warn the customer that's beating up the v6 router or anything, can they? | [18:27] |
| mercutio | for doing traffic? | [18:29] |
| brycec | For disrupting service? | [18:29] |
| mercutio | yeah i'm not sure
it's not like they're ddosing | [18:30] |
| brycec | (Or maybe ARP just needs to get the Cisco v6 router going...) | [18:30] |
| mercutio | just heavy usage.
improving the router situation is important medium to long term not having dropouts is important short term | [18:30] |
| brycec | The Acceptable Use Policy section 2.2 and 2.3 could be broadly interpreted as being violated :P
But like I've said before, I don't care too much, I just connect over ipv4 and carry on. | [18:31] |
| mercutio | heh | [18:33] |
| brycec | (even if I would be happier with v6... and not running up my bandwidth quota :p) | [18:33] |
| mercutio | i'm sure you're nowhere near your quota | [18:33] |
| brycec | whoa I've used 25% of my monthly quota actually
208.68/800GB but that's also normal | [18:34] |
| mercutio | 25%
nothing to worry about | [18:34] |
| brycec | for me. Not exceptionally high due to all my terminal traffic now going over v4 :P | [18:34] |
| mercutio | heh | [18:34] |
| brycec | If I was worried, I'd tunnel through my employer's dedicated with 12TB or whatever it is
(Yep, 12TB of bandwidth) | [18:34] |
| mercutio | it's 10TB on arp metal | [18:35] |
| brycec | We have 12TB
And 504GB used this month | [18:35] |
| mercutio | heh | [18:35] |
| brycec | All-time we've used only 3.4TB | [18:36] |
| mercutio | wow
i think i've used more than that personally | [18:36] |
| brycec | I thought so too personally, but my own yearly usage was <2TB
And in our defence, we weren't using that host until July | [18:37] |
| mercutio | 56.11GB/year | [18:38] |
| brycec | mercutio: can you confirm which is inbound/outbound on the graphs - is inbound internet->VPS/dedi? (or is it relative to the switch port, inbound is host -> switch)
brycec is wondering why he has a 200Mbps spike"in" *spike "inbound" | [18:38] |
| mercutio | i think it's reversed | [18:39] |
| brycec | okay that would make sense to me then (uploading a chunk of data) | [18:39] |
| mercutio | because it's monitoring the router rather than the host
but don't hold me to that :) | [18:39] |
| brycec | If you really didn't want to be held accountable for that remark, should've started your message with [OFF] :P
Now we have logs.... | [18:40] |
| mercutio | or just say i think
rather than i know :) | [18:40] |
| brycec | status update on my home HE -> ARP VPS mtr: 17 dropped out of 1500.
So, pretty quiet | [18:41] |
| mercutio | i'll be back in a bit
sweet that sounds way better i'll check it agian in a bit :) | [18:41] |
| brycec | brycec reconnects over ipv6
we'll see how this goes... assuming I'm at my tmux to notice | [18:42] |
| ..... (idle for 21mn) | ||
| *** | Guest91502 is now known as easymac
easymac is now known as Guest36744 | [19:03] |
| ............ (idle for 55mn) | ||
| m0unds has joined #arpnetworks | [19:59] | |
| Guest36744 is now known as easymac
easymac is now known as Guest44560 | [20:05] | |
| .......... (idle for 45mn) | ||
| brycec | blargh dropped a few packets just then
but still better than the other day | [20:50] |
| m0unds | yea, was pretty bad | [20:51] |
| mercutio | hmm i'm seeing a bit of bursts of jitter up to like 25 msec | [20:52] |
| m0unds | i think it's happened a few times in the last mo or so | [20:52] |
| mercutio | then the next second it's fine
when you say drop a few packets you mean like jittery ssh not responding quickly then fine? | [20:52] |
| brycec | brycec only noticed it because he was trying to change tmux windows at the time and it just wouldn't respond | [20:53] |
| mercutio | or like it feels like it's dropping out. | [20:53] |
| brycec | mercutio: I mean mtr says packets were dropped
And also ssh was non-responsive | [20:53] |
| mercutio | a few in a row? | [20:53] |
| brycec | Hard to say
Yes | [20:53] |
| mercutio | well m0unds noticed it too | [20:54] |
| brycec | (thank you mtr "Display Mode") | [20:54] |
| mercutio | heh
yeah when i use mtr i can glance at it cos i see the colour change although it wasn't on screen atm | [20:54] |
| brycec | I'm seeing 4 packets here and there over the last 90 seconds (12 total)
brycec goes back to abusing Syncthing | [20:54] |
| m0unds | haha | [20:55] |
| mercutio | that seems like heaps
ahh i'm seeing loss to www.he.net but no loss to the gateway actually i'm not sure if it's loss to or from | [20:55] |
| brycec | I should add, mercutio, the the loss I'm seeing is on my home HE tunnel -> ARP VPS, starting at the ntt hop (one and only, second to last hop) and continuing to the last hop of my VPS
Another burst of loss there and there | [20:56] |
| mercutio | yeah i'm still seeing loss to www.he.net
i'm trying to find a host site for some reason uk vultr seems down :( i thought that maybe on he | [20:56] |
| brycec | 10 packets in a row just then :(
Cloudflare has native IPv6 IIRC could test to them | [20:58] |
| mercutio | cloudflare doesn't cache my file properly
i was hoping to use iperf to test direction | [20:58] |
| brycec | I figured you were just pinging/mtr'ing | [20:58] |
| mercutio | i was testing with vultr before
but that was hitting gtt | [20:58] |
| brycec | ah | [20:59] |
| JC_Denton | anyone here using freenas? | [21:00] |
| mercutio | my route over ipv4 ius hitting he.net to vultr uk
so hopefully it'll help :) weird it's hitting trit for this route | [21:00] |
| brycec | JC_Denton: Yes | [21:01] |
| m0unds | when it was worst for me was when my v6 route from home traversed he
when it goes over just ntt, it's fine | [21:01] |
| mercutio | m0unds: i think there's at least double issues atm
and one potential issue :) | [21:02] |
| m0unds | daily, haha | [21:02] |
| brycec | my conclusion the other day, m0unds, was that it is a particular HE-NTT handoff that is over-burdened. | [21:02] |
| mercutio | i mean of separate issues | [21:02] |
| m0unds | yeah | [21:02] |
| JC_Denton | brycec: know off the top of your head if the ZFS setup on it supports POSIX ACLs? | [21:02] |
| m0unds | brycec: yeah, that's how it looked to me | [21:02] |
| mercutio | m0unds: but he.net direct was screwed too right?
i mean brycec | [21:02] |
| m0unds | no | [21:02] |
| brycec | JC_Denton: hm no I don't | [21:02] |
| m0unds | but my route changed off he->ntt before i could really dig into it at all | [21:03] |
| brycec | mercutio: can you clarify what you mean by HE direct? | [21:03] |
| mercutio | he.net to he.net
when not hitting ntt was also breaking | [21:03] |
| brycec | JC_Denton: IIRC xacl support is in the underlying ZFS (because FreeBSD) but I never tested it.
mer DAMMIT IPV6 brb | [21:03] |
| m0unds | hahahahah | [21:04] |
| brycec | I'm back to v4. Trying to chat with y'all is impossible :p | [21:04] |
| mercutio | this trit route is like 10 megabit tcp to uk | [21:04] |
| m0unds | need moar missed keystrokes pls | [21:04] |
| brycec | mercutio: How would I test HE-HE? ARP traffic always crossed NTT. | [21:05] |
| mercutio | oh really? | [21:05] |
| brycec | m0unds: bless SSH/TCP it always kept up. | [21:05] |
| m0unds | brycec: are you hitting lax2.he.net?
when you're enroute to arp via your tunnel | [21:05] |
| *** | Guest44560 is now known as easymac | [21:05] |
| brycec | m0unds: yes | [21:05] |
| m0unds | check this out | [21:05] |
| brycec | lax2.he -> lsanca.ntt | [21:05] |
| m0unds | http://pastebin.com/eLLZEMkP | [21:06] |
| brycec | (and it's that lsanca hop that drops) | [21:06] |
| mercutio | this is ntt->cogent and level3->trit and seems ok in both directions | [21:06] |
| *** | easymac is now known as Guest39524 | [21:06] |
| m0unds | that's LAX2-> comcast in NM, and LAX2 -> arp | [21:06] |
| brycec | (hence my conclusion that it's the lax2he->lsanca.ntt hop that is saturated) | [21:06] |
| m0unds | yup | [21:06] |
| mercutio | 2001:418:0:5000::52c is the ntt hop i was seeing drop when it was fine before | [21:07] |
| brycec | I see 52d in my current mtr | [21:07] |
| mercutio | probably the other end of such :)
but yeah that alone seems to mean nothing | [21:07] |
| brycec | or could be another parallel route | [21:08] |
| mercutio | cos 2001:418:0:2000::1ee is fine | [21:08] |
| brycec | (that hop doesn't even appear in my mtr) | [21:08] |
| mercutio | hah why is he.net looking glass showinghigh pings for every hop
this is outbound from arp over ntt | [21:09] |
| m0unds | lax1->lax2 is fine
lax2->lax1 is fine (he to he) it's that ntt hop borking stuff because he->comcast on ipv6 is shitty (goes via ntt) and he->arp is shitty (also goes via ntt iirc) | [21:09] |
| mercutio | 2001:470:0:6c::1
what's your trace to that ip like? | [21:11] |
| brycec | for me, sea1.ipv6.he.net -> sea1.he.nt -> sjc2.he.net -> lax2.he.net no loss (from my home tunnel)
(obviously) | [21:13] |
| mercutio | yeah and that's screwed from arp | [21:13] |
| brycec | And from ARP https://dl.dropboxusercontent.com/u/3167967/screenshot_2015-09-05_21-11-23.png | [21:14] |
| m0unds | 216.218.226.238 tracerouting to this via v4 looks awful, goes through any2ix
(tunnel server in seattle) | [21:19] |
| mercutio | is there something special that makes www.he.net special? | [21:21] |
| m0unds | what do you mean? | [21:21] |
| mercutio | with loss | [21:21] |
| m0unds | is it not bad?
it doesn't go through any2ix | [21:21] |
| mercutio | it is bad | [21:22] |
| m0unds | nm
it does | [21:22] |
| mercutio | but it seems to be bad suddenly | [21:22] |
| m0unds | just no rdns on the hop
any2ix to HE sucks from arp every single one i've tried | [21:22] |
| mercutio | so i'm wondering if it's rate limit
so it's always been bad? and ntt->he is bad | [21:22] |
| m0unds | no, don't think it always has | [21:24] |
| mercutio | but for quite a while? | [21:25] |
| m0unds | maybe, i don't usually see he on my route
but when i saw tons of pkt loss w/unreliable ssh the other night, it involved he and that ntt hop brycec mentioned and any2ix on either the return or other path | [21:25] |
| mercutio | i'm looking for more looking glasse
i foundm something that's slow, but it's even slower over ipv4 and fine from linux, go figure | [21:26] |
| m0unds | huh | [21:37] |
| mercutio | he.net's giving issues again
i'ev found dns server as something beter to ping | [21:37] |
| .... (idle for 18mn) | ||
| and it's he.net incoming rather than outgoing that's the issue | [21:56] | |
| *** | Guest39524 is now known as easymac
easymac is now known as Guest13147 | [22:06] |
| ........... (idle for 54mn) | ||
| mnathani2_ | s/beter/better | [23:01] |
| BryceBot | <mercutio> i'ev found dns server as something better to ping | [23:01] |
| mercutio | heh | [23:01] |
| mnathani2_ | hey where did the 2 come from? | [23:01] |
| mercutio | i got my own tunnel
can test easy now :) | [23:01] |
| *** | mnathani2_ is now known as mnathani_ | [23:01] |
| mercutio | probably from another netsplit
when it says so much loss with mtr, it's actually single direction | [23:01] |
| mnathani_ | there, thats better | [23:02] |
| mercutio | it's traffic into arp via he.net that's the issue | [23:02] |
| mnathani_ | via any2ix? | [23:02] |
| mercutio | and that ntt hop is return path, where arp sends traffic out, so it's not the issue
yeah | [23:02] |
| mnathani_ | congestion? | [23:03] |
| mercutio | i don't think it's actually congestion.
i'm not sure what it is though it's like suddenly packets stop coming through and then it's fine again | [23:03] |
| *** | Guest13147 is now known as easymac
easymac is now known as Guest52803 | [23:08] |
| ↑back Search ←Prev date Next date→ Show only urls | (Click on time to select a line by its url) |
