[01:15] guess people liked that one better [01:26] i'm not actually following that one [01:44] *** LT has joined #arpnetworks [01:52] More twerking. [01:53] i still don't really get twitter [01:53] well i mean i know how it works, but it seems like just another thing to try and keep up with [06:37] the nlnog ring looks like a really nifty concept [06:41] *** CaZe has quit IRC (Remote host closed the connection) [06:41] *** CaZe` has joined #arpnetworks [06:41] *** CaZe` is now known as CaZe [07:43] mercutio: I have bitlbee logging tweets and sometimes I'll search for a given topic, but there's no way I'd read things as they come in, too much info, to much attention and time wasted .. ;-) [09:25] *** LT has quit IRC (Quit: Leaving) [11:06] *** N3RG4L has quit IRC (Ping timeout: 248 seconds) [11:07] *** N3RG4L has joined #arpnetworks [12:17] avj: the ring is awesome [12:17] very nice for diagnostics [12:17] unlike route servers, you have real tools, like mtr [12:33] i like things like mtr :) [12:33] i've noticed that cisco etc route servers are always slwo [12:33] and don't haev nice tools :) [12:34] * mercutio wonders whta this ring thing is [12:39] * brycec wonders too [12:40] https://ring.nlnog.net/ [12:40] Oh right because ARP's a participant. [12:40] i was also wondering what the bgp collective was [12:40] i went to the page i didn't quite understand if they were going to bridge different areas or what [12:41] ok this ring thing does look cool. [12:42] So essentially this is a machine (VM) on your network that you allow other networks' admins access to (and in return, you get access to theirs) in order to troubleshoot the Internet? Is that essentially right? [12:42] that's what the web page suggests [12:44] i wonder there are special mesh traceroute tools [12:45] there are ring scripts [12:45] to do multihost [12:45] https://ring.nlnog.net/user-guide/ [12:45] looks good [12:46] i think it ssh's to every host in turn [12:46] which could be slow :) [12:47] in turn? ick I would hope it would be parallel [12:47] maybe it is, [12:47] but it doesn't look like so [12:47] maybe up_the_irons can confirm when he's aorund :) [12:47] https://raw.github.com/NLNOG/nlnog-ring/master/scripts/ring-ping [12:48] yeh it ssh's to each one [12:48] and there are over 200 [12:49] oh i think the idea is you go to a susbset of htem [12:49] Actually it looks like xargs does the parallelization (but that's just a quick skim [12:50] oh i think you're right [12:50] i hadn't worked my way down that far [12:50] -P10 -- run up to 10 procs at a time [12:50] i was still trying to figure out how it gets the hostnames out of dig [12:51] Fun with reformatting ;) (ignore comments, strip double quotes, and convert spaces into newlines) SERVERS=$(dig -t txt +short ring.nlnog.net | grep -v '^;' | tr -d '"' | tr ' ' '\n') [12:52] Man that's some clever parallellization voodoo [12:52] heh [12:52] so 237 hosts [12:52] bash isn't known for being good at parallellization... but here it is molded to do it :) [12:52] 10 at a time [12:52] with 2 second connect timeout [12:53] so it probably still takes 20 seconds to run or something [12:53] but not so bad [12:53] Better than 4 minutes [12:53] parallelisation is annoying :) [12:53] yeah [12:53] i'd rather see main hubs that send the commands off to servers [12:54] adn give the responses back [12:54] and maintain persistent connectinos open to them [12:54] but i imagine it'd take more effort to implement than the amount of time you'd save [12:54] err take more time to implement [12:54] More moving parts to break too [12:54] And eats up bandwidth (not much, but it adds up) [12:55] in some ways, it also means can throttle requests or such easier [12:55] True [12:55] if someone has a script error or something that ddos's servers accidentally or something [12:55] i doubt bw would increase noticably [12:55] because you also remote ssh connection initialisation overhead etc [12:56] so oyu may send 250 bytes instead of 2k for persistent versus creating new connectoin [12:56] plus less cpu [12:56] Depends how much the ring is used [12:56] probably smokeping takes up more than manual testing [12:57] You can do them one at a time if you want https://github.com/NLNOG/nlnog-ring/blob/master/scripts/ring-all-serial [12:57] if you're smokeping'ing lots of hosts you can reduce bw slightly be reducing the ping size [12:57] heh smokeping is exactly the kind of background noise I'm talking about [12:57] ping loss doesn't seem to make a huge difference between tiny and vewry tiny [12:57] for results [12:58] packetsize = 32 [12:58] so i use that with fping [13:18] brycec: mercutio : you guys are thinking too hard. admin's get SSH access to my ring box and I get SSH access to theirs. So everyone has access to everyone else's system. you can login to whichever one you want at a given time. If I see routing problems in Asia, I might pick a ring node that is located in that region, and then troubleshoot [13:19] up_the_irons: That's exactly what I took away. [13:19] yah [13:19] rather than ping from every host [13:19] 12:42:06 < brycec> So essentially this is a machine (VM) on your network that you allow other networks' admins access to (and in return, you get access to theirs) in order to troubleshoot the Internet? Is that essentially right? [13:19] i was just thinking of things like dns and being able to check what caching is like etc [13:19] brycec: yup that's right :) [13:21] for some reason, the example of asia seems pretty fitting [13:21] i dunno why asia has weird routing [13:21] * brycec blames the ocean, and China. [13:25] i think it's about routing policys most. [13:25] but i'm in new zealand, which sometimes gets classed as asia pacific so some silly cdn's send traffic to asia [13:25] rahter than the US [13:25] which can end up going via the US to asia. [13:26] actually japan seems pretty solid. [13:26] it's singapore that's bad that i notice [13:26] and from what i understnad india and pakistan and so forth are worse. [15:08] wow, sold another dedi (and possibly even 1 more, will know later) [15:08] they might be selling faster than VPSes this last week ;) [15:19] *** nikogonzo has quit IRC (Ping timeout: 264 seconds) [15:23] up_the_irons: another one since my one? [15:23] mercutio: yep [15:23] the dedicated servers have only been going about 6 months right? [15:23] mercutio: two actually, if the 2nd guy passes the OpenVPN/IPMI litmus test [15:24] haha that's a test? :) [15:24] shit i didn't know i was being tested. [15:24] lol [15:24] mercutio: a year; officially launched dedi's on 10/23/12, although several were sold before then [15:24] oh wow [15:24] time flies [15:24] mercutio: yup you passed [15:25] are there many colo servers? [15:25] i prefer colo to dedicated when it's local [15:26] but i imagine that doesnt' hold true for everyone [15:28] mercutio: there's many colo'd, yes, 2 cabs; and i've been sold out of colo forever b/c those cabs are still full [15:28] ahh [15:28] and it's expensive to do another cabinet [15:28] if it's not full [15:30] up_the_irons: Any progress on the polo? [15:30] well it's more that my cage got full, so i couldn't add another cab [15:30] oh [15:30] and expanding is expensive [15:30] lol [15:30] so does that mean you're running out of space in general? [15:31] brycec: waiting for my tshirt to come and see if i like 'em [15:31] are you at the primary or secondary dc? [15:31] pretty damn near at this point [15:31] damn [15:31] i might grab a cab in another cage that i already have an x-conn to [15:31] that a buddy of mine runs [15:31] have you checked out the 10k sata disks btw? [15:32] i wonder how they'd go for vm's [15:32] dunno if they support tler or not [15:32] http://www.newegg.com/Product/Product.aspx?Item=N82E16822236243 [15:32] these [15:32] Western Digital WD VelociRaptor WD1000DHTZ 1TB 10000 RPM 64MB Cache SATA 6.0Gb/s 3.5" Internal Hard Drive Bare Drive -- $229.99 [15:33] they're meant to do 200mb/sec sequential [15:34] pretty low power usage i think too, as 2.5" in an expansion tray [15:35] which apparently isn't needed if in proper ventilated servers [15:37] sounds like it should have tler, and similar errror rate per bits as re4 [16:17] *** r0ni has joined #arpnetworks [18:19] hey gizmoguy - ever had the opportunity to try stuff from New Belgium brewery in Ft Collins, CO? [18:20] can't say I have [18:21] they have some great stuff. #3 craft brewery in the U [18:21] toured the brewery today, lots of fun + beer tasting [18:22] awesome [18:22] sounds like a good day [18:22] I'm sitting here watching contractors fix my AC that died in my machine room over night.. [18:22] yeah, just wish i had more time in colorado so i could hit odell and oskar blues [18:23] much rather be drinking! [18:23] oh damn, haha [18:23] luckily I have 4 days off at the end of this week to fly and go drinking :D [18:23] lose anything in the eq room? [18:24] nah, not a complete failure [18:24] right on. ive got another 7 days off. finally getting to burn some pto and spend some time with my wife. she's been so busy with grad school and work that i rarely see her [18:24] just a failure in the cooling department [18:24] it still circulates air [18:24] that's good. cooling failures suck. [18:24] just room temp air instead of chilled air [18:24] it dies once a year... [18:24] gotcha [18:24] oh, that's great [18:25] the company that has the contract seem incapable of fixing it [18:25] better get yourself certified to work on hvac gear so you can fix it right :P [18:25] I've got their old slow guy at the moment [18:25] i'm sorta hoping they escalate to someone who moves a bit faster [18:25] cause I want to go home at the end of the day :P [18:26] haha true [18:26] so far this guy turned up [18:26] I explained problem [18:26] and then he pulled out his ladder [18:26] and then I heard lots of clunking and smashing [18:26] and some swearing [18:26] and I kinda walked away after that [18:28] ah crap [18:28] brb [18:28] http://i.imgur.com/ngaV7Fp.png [18:28] what is this guy doing?! [18:30] hah [18:31] Ok [18:31] so [18:31] he turned the AC unit off [18:31] and then walked away apparently [18:31] without telling me [18:31] "fixed!" [18:31] .... [18:32] so I'm attempting to cool with my backup cooling system [18:32] which involves opening some doors :P [18:33] up til recently, my backup cooling was opening up the ceiling to let the hot air escape [18:35] oh holy crap [18:35] i'm in like a hundred channels on freenode [18:35] i don't remember joining half of them [18:36] i'm in exactly one channel on freenode: this one [18:37] Good, the most important one! [18:37] I'm in about 20 or so, most of them fairly quiet. [18:38] im just not a big fan of freenode [18:38] oh counting just FN? I think just 4 of those are FN channels [18:38] 1 windows used (0 vertically / 0 horizontally split). 56 (of which 0 merged) buffers open: 1 core, 12 irc servers, 2 perl, 41 irc channels [18:39] used to hang out in #pfsense and #m0n0wall years ago [18:40] 56 channels? geez [18:40] i dont think i could find that many channels that id care enough about to even idle in [20:22] *** awyeah_ has joined #arpnetworks [20:22] *** joepie91_ has joined #arpnetworks [20:23] *** anis has joined #arpnetworks [20:23] *** nesta has quit IRC (Ping timeout: 245 seconds) [20:23] *** r0ni has quit IRC (*.net *.split) [20:23] *** joepie91 has quit IRC (*.net *.split) [20:23] *** awyeah has quit IRC (*.net *.split) [20:23] *** anisfarhana has quit IRC (*.net *.split) [20:23] *** mhoran has quit IRC (*.net *.split) [20:37] *** nesta has joined #arpnetworks [22:48] m0unds: you picked the right channel :)