[01:03] *** nipuL has joined #arpnetworks
[01:07] *** heavysixer_ has joined #arpnetworks
[01:07] *** ChanServ sets mode: +o heavysixer_
[01:08] *** amdprophet has quit IRC (*.net *.split)
[01:08] *** heavysixer has quit IRC (*.net *.split)
[01:08] *** nipuL_ has quit IRC (*.net *.split)
[01:08] *** heavysixer_ is now known as heavysixer
[01:14] *** DigiBSD has joined #arpnetworks
[01:20] *** LT has joined #arpnetworks
[01:53] *** mango has joined #arpnetworks
[01:53] <mango> hello
[01:54] <Wraithan> howdy
[01:54] <mango> good h`r`u
[01:54] <mango> any admin online ?
[01:55] <Wraithan> up_the_irons: ^
[01:55] <mango> up_the_irons: how are you?
[01:56] <up_the_irons> what's up
[01:56] <mango> up_the_irons: can i go to priv ?
[01:57] <up_the_irons> yes
[02:01] *** nerdd has joined #arpnetworks
[02:03] *** nerdd_ has quit IRC (Ping timeout: 258 seconds)
[02:12] *** mango has quit IRC (Quit: leaving)
[02:27] *** Ehtyar has quit IRC (Remote host closed the connection)
[02:32] *** Ehtyar has joined #arpnetworks
[02:48] *** amdprophet has joined #arpnetworks
[02:59] *** schmir has joined #arpnetworks
[03:08] *** schmir has quit IRC (Ping timeout: 240 seconds)
[08:11] *** ziyourenxiang has joined #arpnetworks
[09:20] *** amdprophet has quit IRC (Ping timeout: 240 seconds)
[09:23] *** LT has quit IRC (Quit: Leaving)
[09:44] *** ziyourenxiang has quit IRC (Quit: ziyourenxiang)
[09:46] *** DigiBSD has quit IRC (Quit: Quitte)
[10:26] <jdoe> up_the_irons: mzima fucked up on the weekend again :/
[10:27] *** cmeiklej1hn has joined #arpnetworks
[10:27] *** cmeiklej1hn has quit IRC (Client Quit)
[11:08] *** schmir has joined #arpnetworks
[11:21] *** schmir has quit IRC (Remote host closed the connection)
[12:37] <bob^^> yup, i can confirm that
[12:45] *** Ehtyar has quit IRC (Remote host closed the connection)
[12:45] <up_the_irons> jdoe: they had "emergency" maintenance and had to power cycle a switch to clear routing alarms.
[13:16] <jdoe> up_the_irons: er, which part of that lasted several hours? :)
[13:32] <mick_laptop> up_the_irons: how much for a reverse dns entry?
[13:35] <mick_laptop> err, not what i meant
[13:35] <mick_laptop> how much to point my ip to my hostname
[13:36] <jdoe> put in ticket, magic happens.
[13:39] <mick_laptop> i'm running on like 3 hrs sleep
[13:39] <mick_laptop> i've had so many face-palm moments today....
[14:35] *** cmeiklej1hn has joined #arpnetworks
[14:36] *** cmeiklej1hn has quit IRC (Client Quit)
[14:38] *** Ehtyar has joined #arpnetworks
[14:43] <up_the_irons> jdoe: it didn't last several hours; I show traffic going in/out their circuit continuously throughout the weekend.  BGP re-routed to other circuits during the reboot.
[14:43] <bob^^> i'd agree with jdoe up_the_irons - i lost connectivity to my VPS for at least four hours
[14:43] <bob^^> possibly more - i went to bed (by morning (around 6 hours later)) it was fine
[14:44] <bob^^> tracerouting showed it lost in mzima's LAX network consistently during that time
[14:44] <up_the_irons> bob^^: not sure what to say, I didn't get any support requests regarding packet loss all weekend
[14:44] <up_the_irons> maybe it's a separate issue, who knows
[14:45] <bob^^> didn't affect me really so didn't worry about reporting it - however your website was down too
[14:45] <bob^^> tbh i should have kept traceroutes :(
[14:45] <bob^^> you'd think i'd know better tbh :)
[14:46] <up_the_irons> i'm sure at some point i'm going to nix that circuit; their quality of service has just gone south
[14:46] <bob^^> such a shame :(
[14:46] *** cmeiklej1hn has joined #arpnetworks
[14:47] <bob^^> if it happens again i'll gather all the usual stuff - i'll dig out all the proper stuff from our looking glass at the time too
[14:47] <up_the_irons> thanks
[14:47] <up_the_irons> bob^^: jdoe : where are you guys located?
[14:48] <bob^^> right smack bang in the middle of the UK - problems from my home internet connection and also from work (where we run the whole ISP and peer etc etc)
[14:48] <up_the_irons> i c
[14:50] <bob^^> both ISPs (home and work) take similar paths, and both got into mzima's network then went dead at lax<something> within mzima's network
[14:52] <jdoe> up_the_irons: dunno either, I've got a euro user, he couldn't connect for hours, traceroutes died in mzima. I certainly would have expected it to be routed around, but it wasn't.
[14:52] *** cmeiklej1hn is now known as cmeik
[14:53] <bob^^> guess that's the same issue i saw
[14:53] <bob^^> at the time, to be fair, others in here had no rpoblems at all (presumably US users)
[14:54] <jdoe> yeah. I'm NA, I never disconnected.
[14:54] <RandalSchwartz> nor did I
[14:54] <RandalSchwartz> it Just Worked
[14:57] <up_the_irons> jdoe: bob^^ : sounds like the problem may have affected only EU users
[14:58] <up_the_irons> just sent an email off to Level 3.  They gave me a good quote last year, let's see what they do now...
[14:58] <bob^^> :)
[14:58] <up_the_irons> I'd be a couple hops closer to everything anyway, since Mzima uses Level 3 a ton
[14:58] <bob^^> as i say, if it happens again i'll do all the info gathering and fire it over - should be able to provide enough detail for them to work it out
[14:58] <bob^^> yeah, our main transit provider uses l3 a load too
[15:02] <up_the_irons> cool
[15:03] *** cmeik has quit IRC (Quit: leaving)
[17:21] *** mart1n has quit IRC (Ping timeout: 252 seconds)
[17:22] *** mart1n has joined #arpnetworks
[18:55] <cedwards> up_the_irons: you've got me paranoid about changing the installs on my box.
[20:58] <jdoe> lol
[21:08] *** residual has joined #arpnetworks
[21:11] *** residual has left